-- Logs begin at Mon 2021-12-20 02:31:38 UTC, end at Mon 2021-12-20 03:47:31 UTC. -- Dec 20 03:19:29.217903 dv-cinder-818037-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 20 03:19:29.227227 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 20 03:19:29.228954 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Dec 20 03:19:29 2021] *** Dec 20 03:19:29.228954 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 20 03:19:29.228954 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 20 03:19:29.228954 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: nodename: dv-cinder-818037-11-iscsi Dec 20 03:19:29.228954 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: machine: x86_64 Dec 20 03:19:29.228954 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: clock source: unix Dec 20 03:19:29.228954 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: pcre jit disabled Dec 20 03:19:29.228954 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: detected number of CPU cores: 4 Dec 20 03:19:29.228954 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: current working directory: / Dec 20 03:19:29.228954 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: detected binary path: /usr/bin/uwsgi-core Dec 20 03:19:29.228954 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: your processes number limit is 47680 Dec 20 03:19:29.230055 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: your memory page size is 4096 bytes Dec 20 03:19:29.230055 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: detected max file descriptor number: 2048 Dec 20 03:19:29.230055 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: lock engine: pthread robust mutexes Dec 20 03:19:29.230055 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: thunder lock: enabled Dec 20 03:19:29.230055 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 20 03:19:29.230055 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 20 03:19:29.275214 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: Python main interpreter initialized at 0x55fb83e979c0 Dec 20 03:19:29.275214 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: python threads support enabled Dec 20 03:19:29.275214 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: your server socket listen backlog is limited to 100 connections Dec 20 03:19:29.275214 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: your mercy for graceful operations on workers is 90 seconds Dec 20 03:19:29.275890 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: mapped 403077 bytes (393 KB) for 2 cores Dec 20 03:19:29.275890 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: *** Operational MODE: preforking *** Dec 20 03:19:29.276110 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: *** uWSGI is running in multiple interpreter mode *** Dec 20 03:19:29.276110 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: spawned uWSGI master process (pid: 102579) Dec 20 03:19:29.278059 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: spawned uWSGI worker 1 (pid: 102580, cores: 1) Dec 20 03:19:29.278059 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: spawned uWSGI worker 2 (pid: 102581, cores: 1) Dec 20 03:19:29.278059 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 20 03:19:29.276195 dv-cinder-818037-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 20 03:19:31.046776 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 20 03:19:31.046776 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: from cryptography.utils import int_from_bytes Dec 20 03:19:31.047609 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 20 03:19:31.047609 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: from cryptography.utils import int_from_bytes Dec 20 03:19:31.049381 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 20 03:19:31.049381 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: from cryptography.utils import int_from_bytes Dec 20 03:19:31.050130 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 20 03:19:31.050130 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: from cryptography.utils import int_from_bytes Dec 20 03:19:33.730013 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 20 03:19:33.730660 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 20 03:19:33.730766 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 20 03:19:33.731113 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 20 03:19:33.731368 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 20 03:19:33.731757 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.732086 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.732412 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.732736 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.732968 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 20 03:19:33.733544 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.733696 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 20 03:19:33.733845 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.733845 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.734098 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 20 03:19:33.734251 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.734371 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 20 03:19:33.734506 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.734634 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 20 03:19:33.734757 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.734853 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.734951 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.735044 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.735245 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-11-iscsi {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.735363 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.735520 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.735670 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.735838 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.736056 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.736219 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.736422 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.736581 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.736753 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.736864 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.737075 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.737238 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.737413 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.737528 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.737688 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.737917 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.738417 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.738417 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-11-iscsi {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.738705 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.738853 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.739005 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.739147 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.739347 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.739494 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.739623 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.739751 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.739910 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.740117 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.740227 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.740350 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.740470 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.740551 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.740743 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.740925 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.741078 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.741248 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.741394 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.741556 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-11-iscsi {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.741769 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.741927 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.742075 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.742212 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.742355 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.742488 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.742629 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.742823 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.743242 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.743443 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.743600 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.743734 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.743881 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.744019 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.744148 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.744307 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.744452 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.744727 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.744866 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-11-iscsi {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.745060 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.745404 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.745601 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.745722 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.745875 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.745973 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.746135 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.746276 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.746446 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.746575 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.746782 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.746973 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.747080 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.747308 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.747400 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.747640 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.747745 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.747956 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.748057 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.748250 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.748334 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.748566 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.748667 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.748894 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.748981 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.749256 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.749347 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.749560 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.749677 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.749822 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.749908 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.750079 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.750173 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.750407 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.750496 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.750736 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.750833 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.751049 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.751139 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.751320 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.751408 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.751634 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.751780 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.751958 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.752055 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.752271 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.752360 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.752583 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.752681 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.752894 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.752994 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.753167 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.753257 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.753500 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.753590 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.753829 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.753920 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.754145 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.754235 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.754470 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.754642 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.754804 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.754954 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.755112 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.755255 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.53 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.755397 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.755545 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.53 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.755838 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.755980 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.756120 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.756261 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.756394 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.756519 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.756664 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.756807 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.756954 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.757092 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.757253 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.757420 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.757566 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.757715 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.757851 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.757988 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.758182 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.758338 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.53 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.758476 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.758636 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.53 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.758819 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.758964 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.759128 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.759226 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.759382 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.759471 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.759689 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.759778 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.760000 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.760099 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.760370 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.760468 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.760712 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.760867 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.761025 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.761213 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.761363 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.761534 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.761688 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.761846 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.762037 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.762163 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.762347 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.762478 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.762603 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.762792 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.762909 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.763108 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.763215 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.763422 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.763532 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.763731 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.763830 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.764045 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.764138 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.764357 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.764456 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.764670 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.764780 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.764993 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.765080 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.765365 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.765454 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.765681 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.765771 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.765995 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.766092 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.766307 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.766398 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.766616 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.766710 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.766929 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.767035 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.767237 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.767322 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.767545 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.767640 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.767866 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.767952 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.768180 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.768275 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.768488 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.768588 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.768798 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.768898 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.769107 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.769232 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.769439 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.769529 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.769763 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.769865 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.770069 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.770171 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.770380 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.770469 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.770704 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.770799 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.771015 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.771113 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.771326 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.771414 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.771634 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.771724 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.771944 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.772033 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.772254 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.772377 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.772564 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.772657 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.772869 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.772968 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.773204 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.773292 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.773513 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.773601 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.773827 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.773923 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.774136 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.774229 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.774444 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.774533 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.774752 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.774851 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.775062 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.775155 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.775371 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.775464 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.775679 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.775780 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.776540 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.776655 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.776840 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.776962 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.777207 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.777297 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.777678 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.777798 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.777880 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.778016 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.778196 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.778283 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.778502 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.778597 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.778827 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.778917 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:19:33.779158 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.779250 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.779476 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.779572 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.779794 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.779892 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.780112 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.780208 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.780436 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.780521 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.780760 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.780865 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.781078 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.781235 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.781446 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.781542 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.781765 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.781865 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.782091 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.782176 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.782409 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.782503 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.782718 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.782816 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.783050 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.783138 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.783370 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.783460 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.783684 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.783784 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.784013 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.784098 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.784334 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.784423 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.784657 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.784755 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.784982 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.785070 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.785326 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.785415 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.785647 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.785745 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.785965 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.786050 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.786286 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.786375 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.786600 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.786689 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.786935 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.787023 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.787256 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.787356 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.787582 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.787734 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.787916 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.788010 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.788244 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.788337 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.788567 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.788661 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.788884 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.788976 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.789219 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.789350 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.789532 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.789620 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.789850 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.789942 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.790161 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.790266 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.790475 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.790561 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.790809 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.790900 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.794175 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.794360 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.794360 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.794569 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.794674 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.794777 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.794777 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.794982 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.795087 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.795189 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.795291 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.795401 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.795518 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.795631 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.795736 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.795837 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.795939 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.796048 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.796210 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.796317 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.796420 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.796530 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.796657 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.796739 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.796826 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.796905 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.796982 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.797057 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.797154 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.797236 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.797327 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.797407 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.797490 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.797569 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.797646 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.797721 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.797806 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.797884 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.797968 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.798046 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.798122 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.798214 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.798293 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.798376 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.798480 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.798564 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.798784 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.798885 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.799097 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.799184 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.799429 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.799522 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.799757 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.799853 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.800075 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.800161 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.800383 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.800469 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.800702 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.800797 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.801014 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.801100 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.801351 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.801440 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.801662 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.801750 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.801978 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.802066 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.802289 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.802375 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.802600 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.802691 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.802909 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.802996 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.803224 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.803351 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.803533 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.803633 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.803838 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.803924 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.804150 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.804258 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.804459 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.804545 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.804767 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.804857 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.805070 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.805189 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.805405 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.805500 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.805717 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.805803 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.806024 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.806125 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.806331 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.806424 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.806658 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.806743 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.806971 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.807141 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.807405 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.807582 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.807855 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.808055 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.808200 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.808296 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.808385 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.808467 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.808581 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.808675 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.808903 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.809062 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.809252 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.809388 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.809570 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.809719 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.809896 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.810088 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.810222 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.810410 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.810544 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.810733 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.810839 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.811053 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.811188 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.811372 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.811511 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.811689 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.811835 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.812003 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.812141 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.812330 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.812462 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.812647 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.812780 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.812971 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.813105 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.813314 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.813458 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.813646 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.813777 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.813961 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.814097 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.814275 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.814407 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.814584 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.814717 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.814897 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.815038 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.815222 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.815359 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.815538 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.815628 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.815864 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.815948 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.816182 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.816273 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.816510 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.816589 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.816827 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.817063 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.817238 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.817386 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.817519 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.817660 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.817813 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.817971 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.818110 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.818209 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.818401 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.818477 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.818716 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.818791 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.819038 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.819123 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.819353 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.819437 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.819666 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.819741 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.819980 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.820066 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.820298 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.820374 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.820606 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.820679 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.820916 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.820992 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.821268 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.821412 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.821589 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.821757 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.821905 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.822079 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.822221 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.822398 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.822530 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.822727 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.822919 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.823248 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.823767 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.823870 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.823937 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.824172 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.824509 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.824642 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.824821 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.825064 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.825212 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.825492 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.825643 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.825804 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.826116 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.826201 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.826446 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.826729 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.826817 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.827060 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.827373 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.827458 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.827683 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.827983 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.828071 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.828337 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.828557 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.828650 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.828961 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.829121 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.829314 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.829632 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.829719 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.829957 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.830258 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.830359 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.830574 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.830808 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.830937 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.831205 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.831373 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.831519 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.831836 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.831949 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.832152 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.832465 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.832712 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.832800 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.833089 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.833327 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.833455 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.833727 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.833913 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.834036 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.834339 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.834513 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.834655 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.834980 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.835114 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.835572 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.835686 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.835910 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.836290 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.836433 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.836547 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.836812 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.836932 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.837182 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.837430 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.837558 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.837838 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.838020 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.838246 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.839041 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.839160 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.839286 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.839594 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.839815 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.839902 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.840202 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.840414 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.840502 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.840805 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.841000 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.841112 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.841451 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.841638 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.841756 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.842063 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.842249 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.842399 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.842706 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.842831 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.843025 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.843332 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.843424 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.843649 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.843956 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.844053 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.844282 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.844584 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.844670 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.844891 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.845207 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.845322 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.845524 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.845876 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.845984 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.846182 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.846523 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.846624 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.846856 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.847128 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.847223 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.847498 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.847724 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.847813 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.848121 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.848320 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.848430 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.848739 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.848904 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.849054 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.849393 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.849535 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.849709 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.850017 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.850117 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.850333 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.850647 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.850736 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.850963 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.851278 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.851375 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.851584 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.851863 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.851949 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.852193 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.852512 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.852616 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.852824 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.853167 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.853258 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.853459 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.853773 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.854188 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.854881 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.855068 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.855439 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.855540 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.855810 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.856092 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.856180 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.856428 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.856696 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.856782 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.857036 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.857354 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.857457 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.857683 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.857963 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.858058 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.858313 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.858594 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.858701 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.858919 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.859215 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.859317 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.859533 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.859814 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.859915 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.860134 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.860391 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.860491 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.860757 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.860986 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.861073 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.861402 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.861601 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.861702 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.862013 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.862163 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.862323 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.862634 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.862756 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.862946 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.863255 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.863340 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.863561 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.863868 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.864003 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.864174 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.864470 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.864565 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.864794 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.865063 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.865179 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.865432 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.865690 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.865787 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.866035 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.866379 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.866480 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.866687 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.867027 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.867120 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.867343 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.867615 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.867717 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.868220 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.868465 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.868600 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.868833 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.869047 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.869178 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.869473 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.869696 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.869834 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.870156 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.870287 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.870479 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.870785 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.870904 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.871094 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.871420 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.871514 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.871734 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.872050 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.872143 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.872376 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.872635 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.872720 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.873014 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.873345 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.873437 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.873658 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.874064 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.874171 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.874286 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.874575 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.874722 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.874897 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.875211 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.875353 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.875536 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.875829 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.875961 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.876142 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.876456 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.876595 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.876766 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.877047 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.877205 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.877410 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.877664 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.877760 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.878033 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.878282 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.878385 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.878641 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.878961 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.879065 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.879271 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.879572 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.879659 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.879879 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.880150 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.880318 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.880633 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.880725 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.880950 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.881287 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.881539 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.881652 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.881907 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.881994 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.882227 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.882500 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.882596 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.882838 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.883097 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.883261 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.883580 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.883666 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.883895 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.884214 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.884322 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.884524 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.884832 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.884941 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.885154 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.885494 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.885600 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.885837 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.886064 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.886161 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.886443 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.886771 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.886868 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.887080 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.887380 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.887476 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.887821 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.887964 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.888141 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.888453 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.888551 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.888876 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.889127 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.889241 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.889534 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.889744 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.889848 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.890183 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.890326 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.890509 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.890819 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.890911 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.891136 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.893713 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.893828 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.893979 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.894069 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.894198 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.894198 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.894505 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.894587 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.894587 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.894783 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.894868 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.894868 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.895030 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.895117 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.895117 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.895309 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.895401 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.895481 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.895562 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.895562 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.895760 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.895868 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.895987 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.896132 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.896300 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.896611 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.896739 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.896929 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.897264 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.897356 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.897580 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.897913 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.897999 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.898223 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.898508 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.898597 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.898841 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.899096 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.899186 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.899454 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.899685 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.899772 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.900076 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.900281 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.900369 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.900699 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.901427 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.901643 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.902050 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.902215 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.902383 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.902696 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.902789 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.903025 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.903339 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.903460 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.903649 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.903954 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.904043 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.904263 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.904551 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.904734 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.904894 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.905157 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.905309 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.905577 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.905752 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.905926 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.906217 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.906363 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.906554 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.906886 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.907029 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.907205 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.907481 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.907627 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.907842 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.908046 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.908191 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.908445 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.908595 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.908760 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.909069 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.909261 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.909415 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.909707 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.909931 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.910071 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.910311 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.910483 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.910631 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.910909 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.911054 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.911232 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.911532 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.911676 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.911853 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.912145 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.912286 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.912457 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.912723 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.912827 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.913060 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.913433 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.913537 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.913741 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.914019 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.914107 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.914395 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.914623 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.914724 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.915044 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.915235 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.915358 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.915689 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.915833 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.916010 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.916333 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.916429 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.916751 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.917077 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.917187 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.917432 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.917699 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.917845 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.918058 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.918309 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.918452 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.918679 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.918911 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.919080 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.919309 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.919510 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.919893 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.920078 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.920227 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.920546 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.920665 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.920864 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.921204 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.921325 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.921527 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.921846 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.921932 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.922166 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.922485 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.922574 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.922803 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.923085 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.923181 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.923443 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.923703 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.923793 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.924095 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.924322 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.924441 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.924773 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.924910 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.925098 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.925445 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.925535 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.925770 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.926072 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.926160 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.926452 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.926642 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.926779 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.927071 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.927239 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.927378 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.927699 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.927833 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.928019 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.928336 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.928482 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.928657 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.928930 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.929069 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.929308 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.929523 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.929614 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.929937 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.930122 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.930258 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.930591 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.930721 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.930932 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.931260 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.931368 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.931578 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.931837 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.931935 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.932717 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.932950 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.933323 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.933648 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.933779 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.933988 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.934322 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.934416 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.934650 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.934979 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.935095 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.935301 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.935568 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.935653 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.935932 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.936159 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.936256 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.936552 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.936746 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.936865 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.937196 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.937389 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.937527 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.937845 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.937973 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.938156 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.938481 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.938780 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.938870 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.939348 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.939494 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.939710 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.939938 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.940034 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.940360 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.940505 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.940697 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.941023 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.941110 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.941366 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.941681 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.941774 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.942002 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.942252 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.942351 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.942624 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.942829 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.942941 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.943252 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.943403 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.943562 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.943881 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.944197 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.944283 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.944508 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.944771 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.944873 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.945123 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.945401 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.945519 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.945775 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.945943 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.946085 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.946395 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.946490 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.946715 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.946915 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.947012 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.947314 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.947401 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.947621 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.948477 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.948760 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.948859 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.949105 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.949255 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.949458 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.949610 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.949847 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.949960 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.950184 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.950283 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.950496 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.950590 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.950814 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.950911 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.951125 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.951277 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.951459 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.951609 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.951773 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.951930 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.952083 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.952364 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.952451 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.952694 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.952791 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.953020 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.953108 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.953364 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.953454 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.953683 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.953860 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.954030 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.954118 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.954346 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.954431 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.954673 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.954925 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.955015 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.955317 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.955428 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.955642 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.955739 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.955964 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.956050 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.956295 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.956399 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.956607 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.956706 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.956929 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.957064 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.957258 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.957363 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.957591 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.957704 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.957915 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.958049 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.958234 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.958416 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.958545 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.958752 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.958854 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.959077 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.959168 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.959417 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.959599 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.959752 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.959961 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.960103 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.960242 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.960375 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.960520 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.960656 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.960806 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.960973 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.961106 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.961317 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.961423 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.961651 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.961740 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.961967 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.962056 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.962287 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.962385 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.962601 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.962700 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.962917 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.963011 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.963228 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.963316 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.963578 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.963911 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.963998 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.964255 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.964358 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.964600 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.964697 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.964927 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.965014 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.965323 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.965444 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.965649 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.965737 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.965965 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.966051 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.966296 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.966385 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.966615 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.966714 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.966929 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.967065 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.967242 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.967344 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.967554 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.967641 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.967876 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.967963 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.968203 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.968300 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.968522 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.968611 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.968858 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.968945 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.969214 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.969305 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.969536 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.969639 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.969876 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.969990 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.970187 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.970276 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.970496 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.970585 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.970808 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.970907 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.971125 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.971215 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.971433 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.971527 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.971742 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.971840 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.972058 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.972152 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.972368 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.972466 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.972679 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.972768 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.972988 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.973081 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.973327 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.973428 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.973636 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.973726 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.973949 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.974081 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.974261 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.974407 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.974585 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.974695 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.974894 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.974986 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.975227 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.975320 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.975568 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.975714 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.975848 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.975980 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.976138 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.976292 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.976447 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.976594 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.976759 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.976893 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.977092 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.977261 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.977436 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.977532 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.977746 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.977836 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.978076 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.978174 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.978398 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.978485 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.978711 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.978810 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.979058 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.979167 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.979390 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.979603 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.979728 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.979940 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.980118 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.980267 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.980398 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.980588 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.980682 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.980910 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.981012 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.981256 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.981348 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.981816 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.982805 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.982805 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.982980 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.983063 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.983141 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.983289 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.983371 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.984090 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.984236 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.984327 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.984406 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.984495 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.984575 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.984733 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.984816 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.984894 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.984971 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.985050 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.985192 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.985293 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.985376 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.985459 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.985459 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 20 03:19:33.985591 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.985656 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.985950 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.986268 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.986585 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.986920 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.987248 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.987586 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.987929 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.988254 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.988575 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.988895 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.989241 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.989660 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.990002 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.990309 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.990631 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.990956 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.991277 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.991598 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.991916 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.992237 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.992560 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.993127 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.993472 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.993794 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.994114 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.994447 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.995374 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.995707 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.996029 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.996346 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.996668 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.997259 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.997755 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.998108 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.998445 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.998778 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.999103 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.999430 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:33.999763 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.000774 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.000774 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.000774 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.001002 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.001325 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.001657 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.001971 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.002282 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.002607 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.002931 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.003494 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.003829 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.004159 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.005178 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.005299 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.005605 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.005917 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.006249 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.006566 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.006879 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.007196 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.007520 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.007828 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.008142 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.008461 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.008774 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.009085 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.009425 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.009737 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.010076 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.010212 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG oslo_db.sqlalchemy.engines [None req-642f7b24-7fce-475d-8910-9160bf3bdf7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 03:19:34.010499 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.010817 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.011541 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.011541 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.011746 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.012053 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.012409 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.012675 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.012994 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.013329 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.013654 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.013967 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.014284 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.014593 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.014910 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.015219 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.015553 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.015868 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.016354 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.016692 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.017011 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.017368 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.017699 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.018015 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.018385 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.018707 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.019296 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.019690 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.020015 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.020373 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.020712 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.021027 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.021367 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.021681 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.022011 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.022332 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.022644 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.022967 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.023279 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.023593 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.024029 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.024348 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.024662 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.024977 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.025323 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.025672 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.026031 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.026363 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.026686 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.027009 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.027323 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.027643 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.027958 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.028272 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.028594 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.028930 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.029276 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.029590 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.030034 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.030351 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.030675 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.031003 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.031316 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.031643 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.031973 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.032451 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.032784 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.033093 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.033455 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.033806 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.034143 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.034476 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.034789 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.035099 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.035407 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.035720 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.036053 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.036389 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.036712 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.037033 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.037383 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.037715 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.038026 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.038349 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.038789 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.039110 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.039427 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.039767 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.040083 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.040399 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.040713 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.041030 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.043193 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.043193 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.043193 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.043193 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.043193 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.043599 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.043745 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.044543 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.044543 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.044816 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.045018 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.045361 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.045685 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.046001 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.046318 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.046640 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.046962 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.047296 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.047624 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.047956 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.048286 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.048637 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.048953 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.049336 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.049664 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.049980 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.050295 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.050664 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:19:34.050931 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 20 03:19:34.074834 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_db.sqlalchemy.engines [None req-d347fd1b-fd92-49b0-9573-f5bfaf38eb76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 03:19:34.079702 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.context [None req-642f7b24-7fce-475d-8910-9160bf3bdf7e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aee21a6b-374f-4375-aa47-f4018ba93cc8(cell1) {{(pid=102581) load_cells /opt/stack/nova/nova/context.py:464}} Dec 20 03:19:34.084127 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-642f7b24-7fce-475d-8910-9160bf3bdf7e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:19:34.085808 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-642f7b24-7fce-475d-8910-9160bf3bdf7e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:19:34.086657 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-642f7b24-7fce-475d-8910-9160bf3bdf7e None None] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:19:34.088787 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-642f7b24-7fce-475d-8910-9160bf3bdf7e None None] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:19:34.101020 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG oslo_db.sqlalchemy.engines [None req-642f7b24-7fce-475d-8910-9160bf3bdf7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 03:19:34.101902 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG oslo_db.sqlalchemy.engines [None req-642f7b24-7fce-475d-8910-9160bf3bdf7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 03:19:34.146723 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.context [None req-d347fd1b-fd92-49b0-9573-f5bfaf38eb76 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aee21a6b-374f-4375-aa47-f4018ba93cc8(cell1) {{(pid=102580) load_cells /opt/stack/nova/nova/context.py:464}} Dec 20 03:19:34.151683 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-d347fd1b-fd92-49b0-9573-f5bfaf38eb76 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:19:34.153545 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-d347fd1b-fd92-49b0-9573-f5bfaf38eb76 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:19:34.154386 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-d347fd1b-fd92-49b0-9573-f5bfaf38eb76 None None] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:19:34.156384 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-d347fd1b-fd92-49b0-9573-f5bfaf38eb76 None None] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:19:34.169127 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_db.sqlalchemy.engines [None req-d347fd1b-fd92-49b0-9573-f5bfaf38eb76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 03:19:34.171682 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_db.sqlalchemy.engines [None req-d347fd1b-fd92-49b0-9573-f5bfaf38eb76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 03:19:34.278285 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG oslo_db.sqlalchemy.engines [None req-642f7b24-7fce-475d-8910-9160bf3bdf7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 03:19:34.338298 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_db.sqlalchemy.engines [None req-d347fd1b-fd92-49b0-9573-f5bfaf38eb76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 03:19:34.705431 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: WARNING keystonemiddleware.auth_token [None req-642f7b24-7fce-475d-8910-9160bf3bdf7e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 20 03:19:34.712216 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: WARNING keystonemiddleware.auth_token [None req-642f7b24-7fce-475d-8910-9160bf3bdf7e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 20 03:19:34.828941 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: WARNING keystonemiddleware.auth_token [None req-d347fd1b-fd92-49b0-9573-f5bfaf38eb76 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 20 03:19:34.835732 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: WARNING keystonemiddleware.auth_token [None req-d347fd1b-fd92-49b0-9573-f5bfaf38eb76 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 20 03:19:35.052329 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: WARNING keystonemiddleware.auth_token [None req-642f7b24-7fce-475d-8910-9160bf3bdf7e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 20 03:19:35.058499 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: WARNING keystonemiddleware.auth_token [None req-642f7b24-7fce-475d-8910-9160bf3bdf7e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 20 03:19:35.063837 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fb83e979c0 pid: 102581 (default app) Dec 20 03:19:35.066180 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-642f7b24-7fce-475d-8910-9160bf3bdf7e None None] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:19:35.067403 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-642f7b24-7fce-475d-8910-9160bf3bdf7e None None] 10.222.0.53 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001961 Dec 20 03:19:35.067845 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 1/1] 10.222.0.53 () {50 vars in 788 bytes} [Mon Dec 20 03:19:35 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:19:35.180129 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: WARNING keystonemiddleware.auth_token [None req-d347fd1b-fd92-49b0-9573-f5bfaf38eb76 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 20 03:19:35.186004 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: WARNING keystonemiddleware.auth_token [None req-d347fd1b-fd92-49b0-9573-f5bfaf38eb76 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 20 03:19:35.191184 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fb83e979c0 pid: 102580 (default app) Dec 20 03:21:04.074606 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-642f7b24-7fce-475d-8910-9160bf3bdf7e None None] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:21:04.076282 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-642f7b24-7fce-475d-8910-9160bf3bdf7e None None] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001900 Dec 20 03:21:04.076857 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 2/2] 10.222.0.53 () {54 vars in 930 bytes} [Mon Dec 20 03:21:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:21:04.561214 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-64f4a623-399a-4404-90b3-f02d3f4ba253 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:21:04.594461 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-64f4a623-399a-4404-90b3-f02d3f4ba253 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.508274 Dec 20 03:21:04.595373 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 1/3] 10.222.0.53 () {60 vars in 1291 bytes} [Mon Dec 20 03:21:04 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:21:07.129358 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-642f7b24-7fce-475d-8910-9160bf3bdf7e None None] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:21:07.132063 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-642f7b24-7fce-475d-8910-9160bf3bdf7e None None] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003390 Dec 20 03:21:07.133032 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 3/4] 10.222.0.53 () {54 vars in 930 bytes} [Mon Dec 20 03:21:07 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:21:07.204332 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-5633863b-2b1a-4ab8-89b0-30ab37b18ea5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:21:07.223191 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:21:07.223191 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: warnings.warn(msg) Dec 20 03:21:07.332828 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-5633863b-2b1a-4ab8-89b0-30ab37b18ea5 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.192527 Dec 20 03:21:07.334370 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 2/5] 10.222.0.53 () {64 vars in 1282 bytes} [Mon Dec 20 03:21:07 2021] POST /compute/v2.1/flavors => generated 407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:21:07.560827 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-1de73420-753f-4b8f-96a4-cae4d3c33733 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:21:07.563299 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:21:07.563299 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: warnings.warn(msg) Dec 20 03:21:07.683928 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-1de73420-753f-4b8f-96a4-cae4d3c33733 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.340987 Dec 20 03:21:07.693129 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 4/6] 10.222.0.53 () {64 vars in 1335 bytes} [Mon Dec 20 03:21:07 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:21:10.242454 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-5633863b-2b1a-4ab8-89b0-30ab37b18ea5 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:21:10.243754 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-5633863b-2b1a-4ab8-89b0-30ab37b18ea5 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Dec 20 03:21:10.244274 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 3/7] 10.222.0.53 () {54 vars in 930 bytes} [Mon Dec 20 03:21:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:21:10.358493 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-316ee207-6933-4794-be58-be9b58526dcf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "ram": 512, "id": "d1", "disk": 5}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:21:10.378542 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:21:10.378542 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: warnings.warn(msg) Dec 20 03:21:10.488293 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-316ee207-6933-4794-be58-be9b58526dcf admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.236680 Dec 20 03:21:10.488828 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 5/8] 10.222.0.53 () {64 vars in 1282 bytes} [Mon Dec 20 03:21:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:21:10.502002 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-804155a3-b2a6-41a8-83ee-20f30bd6d05c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:21:10.503608 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:21:10.503608 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: warnings.warn(msg) Dec 20 03:21:10.637749 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-804155a3-b2a6-41a8-83ee-20f30bd6d05c admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.139146 Dec 20 03:21:10.638893 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 4/9] 10.222.0.53 () {64 vars in 1335 bytes} [Mon Dec 20 03:21:10 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:21:13.393417 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-316ee207-6933-4794-be58-be9b58526dcf admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:21:13.394432 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-316ee207-6933-4794-be58-be9b58526dcf admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Dec 20 03:21:13.394843 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 6/10] 10.222.0.53 () {54 vars in 930 bytes} [Mon Dec 20 03:21:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:21:13.463122 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-0604510f-3119-4273-ae7c-9f7ed4a1be1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G", "disk": 10, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 1024, "swap": 0}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:21:13.561689 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-0604510f-3119-4273-ae7c-9f7ed4a1be1b admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.158935 Dec 20 03:21:13.569304 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 5/11] 10.222.0.53 () {64 vars in 1282 bytes} [Mon Dec 20 03:21:13 2021] POST /compute/v2.1/flavors => generated 404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:21:13.576976 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-4c8e76e4-76ed-415c-ac71-3be86478a866 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:21:13.648458 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-4c8e76e4-76ed-415c-ac71-3be86478a866 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075386 Dec 20 03:21:13.649719 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 7/12] 10.222.0.53 () {64 vars in 1335 bytes} [Mon Dec 20 03:21:13 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:21:16.875523 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-0604510f-3119-4273-ae7c-9f7ed4a1be1b admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:21:16.876685 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-0604510f-3119-4273-ae7c-9f7ed4a1be1b admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001672 Dec 20 03:21:16.877276 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 6/13] 10.222.0.53 () {54 vars in 930 bytes} [Mon Dec 20 03:21:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:21:16.941918 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-d265314e-155b-49ec-8e34-2919e1cc608c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "name": "ds2G", "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:21:17.028121 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-d265314e-155b-49ec-8e34-2919e1cc608c admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142774 Dec 20 03:21:17.028680 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 8/14] 10.222.0.53 () {64 vars in 1282 bytes} [Mon Dec 20 03:21:16 2021] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:21:17.042470 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-e652d235-3a41-4375-8f21-51e68534555a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:21:17.120454 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-e652d235-3a41-4375-8f21-51e68534555a admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081746 Dec 20 03:21:17.121125 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 7/15] 10.222.0.53 () {64 vars in 1335 bytes} [Mon Dec 20 03:21:17 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:21:19.822139 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-d265314e-155b-49ec-8e34-2919e1cc608c admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:21:19.824089 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-d265314e-155b-49ec-8e34-2919e1cc608c admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002687 Dec 20 03:21:19.824916 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 9/16] 10.222.0.53 () {54 vars in 930 bytes} [Mon Dec 20 03:21:19 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:21:19.905319 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-5f9a7a86-8ee2-4a91-8308-02e2a21e1c43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "disk": 20, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:21:19.980287 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-5f9a7a86-8ee2-4a91-8308-02e2a21e1c43 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.147861 Dec 20 03:21:19.980998 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 8/17] 10.222.0.53 () {64 vars in 1282 bytes} [Mon Dec 20 03:21:19 2021] POST /compute/v2.1/flavors => generated 404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:21:19.994687 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-d9ba07d1-d674-4a70-bd66-1db84db7a77b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:21:20.098121 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-d9ba07d1-d674-4a70-bd66-1db84db7a77b admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107260 Dec 20 03:21:20.106399 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 10/18] 10.222.0.53 () {64 vars in 1335 bytes} [Mon Dec 20 03:21:19 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:21:23.046783 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-5f9a7a86-8ee2-4a91-8308-02e2a21e1c43 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:21:23.047783 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-5f9a7a86-8ee2-4a91-8308-02e2a21e1c43 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Dec 20 03:21:23.048190 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 9/19] 10.222.0.53 () {54 vars in 930 bytes} [Mon Dec 20 03:21:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:21:23.119265 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-17cdfefb-0ab8-451b-b6d5-9397353587b0 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:21:23.146633 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-17cdfefb-0ab8-451b-b6d5-9397353587b0 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.087564 Dec 20 03:21:23.147259 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 11/20] 10.222.0.53 () {60 vars in 1291 bytes} [Mon Dec 20 03:21:23 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:21:25.902792 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-5f9a7a86-8ee2-4a91-8308-02e2a21e1c43 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:21:25.904236 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-5f9a7a86-8ee2-4a91-8308-02e2a21e1c43 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001769 Dec 20 03:21:25.904722 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 10/21] 10.222.0.53 () {54 vars in 930 bytes} [Mon Dec 20 03:21:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:21:25.976462 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-3afbcced-de62-4cc6-bfa5-c530d0990ea8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "name": "m1.tiny", "ram": 512, "vcpus": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:21:26.105688 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-3afbcced-de62-4cc6-bfa5-c530d0990ea8 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.192688 Dec 20 03:21:26.106247 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 12/22] 10.222.0.53 () {64 vars in 1282 bytes} [Mon Dec 20 03:21:25 2021] POST /compute/v2.1/flavors => generated 402 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:21:26.120069 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-e7349fc9-65a3-49a4-9b77-5deac25fb231 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:21:26.205008 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-e7349fc9-65a3-49a4-9b77-5deac25fb231 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088943 Dec 20 03:21:26.205621 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 11/23] 10.222.0.53 () {64 vars in 1332 bytes} [Mon Dec 20 03:21:26 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:21:28.744819 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-3afbcced-de62-4cc6-bfa5-c530d0990ea8 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:21:28.746088 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-3afbcced-de62-4cc6-bfa5-c530d0990ea8 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001658 Dec 20 03:21:28.746798 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 13/24] 10.222.0.53 () {54 vars in 930 bytes} [Mon Dec 20 03:21:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:21:28.820263 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-a2dfac6a-eb00-468e-b9c7-c541e464d29a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2", "ram": 2048, "vcpus": 1}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:21:28.942702 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-a2dfac6a-eb00-468e-b9c7-c541e464d29a admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.188188 Dec 20 03:21:28.943743 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 12/25] 10.222.0.53 () {64 vars in 1282 bytes} [Mon Dec 20 03:21:28 2021] POST /compute/v2.1/flavors => generated 405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:21:28.956302 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-9dcc7107-a8dd-4154-ba81-1950d63966be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:21:29.065842 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-9dcc7107-a8dd-4154-ba81-1950d63966be admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113368 Dec 20 03:21:29.067399 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 14/26] 10.222.0.53 () {64 vars in 1332 bytes} [Mon Dec 20 03:21:28 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:21:31.579025 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-a2dfac6a-eb00-468e-b9c7-c541e464d29a admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:21:31.580077 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-a2dfac6a-eb00-468e-b9c7-c541e464d29a admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Dec 20 03:21:31.580585 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 13/27] 10.222.0.53 () {54 vars in 930 bytes} [Mon Dec 20 03:21:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:21:31.660867 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-582b5a37-ebc6-484c-ac18-56f8dfa85775 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "vcpus": 2, "disk": 40, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:21:31.764578 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-582b5a37-ebc6-484c-ac18-56f8dfa85775 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.173049 Dec 20 03:21:31.765941 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 15/28] 10.222.0.53 () {64 vars in 1282 bytes} [Mon Dec 20 03:21:31 2021] POST /compute/v2.1/flavors => generated 406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:21:31.777930 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-ee392020-af12-4fe0-bb98-693406424362 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:21:31.919727 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-ee392020-af12-4fe0-bb98-693406424362 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.145471 Dec 20 03:21:31.920545 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 14/29] 10.222.0.53 () {64 vars in 1332 bytes} [Mon Dec 20 03:21:31 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:21:35.360810 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-582b5a37-ebc6-484c-ac18-56f8dfa85775 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:21:35.364553 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-582b5a37-ebc6-484c-ac18-56f8dfa85775 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003641 Dec 20 03:21:35.365344 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 16/30] 10.222.0.53 () {54 vars in 930 bytes} [Mon Dec 20 03:21:35 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:21:35.467634 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-c47dcd97-5737-4e30-8400-f539002caaa7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4", "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "name": "m1.large", "vcpus": 4}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:21:35.579794 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-c47dcd97-5737-4e30-8400-f539002caaa7 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.206043 Dec 20 03:21:35.580995 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 15/31] 10.222.0.53 () {64 vars in 1282 bytes} [Mon Dec 20 03:21:35 2021] POST /compute/v2.1/flavors => generated 405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:21:35.593780 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-6c9a95fc-9880-42f2-af35-85441bb969da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:21:35.672377 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-6c9a95fc-9880-42f2-af35-85441bb969da admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081744 Dec 20 03:21:35.685569 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 17/32] 10.222.0.53 () {64 vars in 1332 bytes} [Mon Dec 20 03:21:35 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:21:38.303808 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-c47dcd97-5737-4e30-8400-f539002caaa7 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:21:38.304835 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-c47dcd97-5737-4e30-8400-f539002caaa7 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Dec 20 03:21:38.305434 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 16/33] 10.222.0.53 () {54 vars in 930 bytes} [Mon Dec 20 03:21:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:21:38.383169 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-3471dd5e-1137-49f6-8e31-58aedf792710 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "os-flavor-access:is_public": true, "ram": 16384, "swap": 0}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:21:38.491392 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-3471dd5e-1137-49f6-8e31-58aedf792710 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.179229 Dec 20 03:21:38.492622 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 18/34] 10.222.0.53 () {64 vars in 1282 bytes} [Mon Dec 20 03:21:38 2021] POST /compute/v2.1/flavors => generated 408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:21:38.509587 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-41fda443-846e-4dd0-88e1-a7a188376af4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:21:38.645102 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-41fda443-846e-4dd0-88e1-a7a188376af4 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.141329 Dec 20 03:21:38.646211 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 17/35] 10.222.0.53 () {64 vars in 1332 bytes} [Mon Dec 20 03:21:38 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:21:59.852721 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-3471dd5e-1137-49f6-8e31-58aedf792710 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:21:59.853773 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-3471dd5e-1137-49f6-8e31-58aedf792710 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Dec 20 03:21:59.854288 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 19/36] 10.222.0.53 () {54 vars in 930 bytes} [Mon Dec 20 03:21:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:21:59.914935 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-edb0d27c-140b-484d-b08f-79f3c54d8691 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:21:59.933893 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-edb0d27c-140b-484d-b08f-79f3c54d8691 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072562 Dec 20 03:21:59.934179 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 18/37] 10.222.0.53 () {60 vars in 1291 bytes} [Mon Dec 20 03:21:59 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:22:01.680836 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-3471dd5e-1137-49f6-8e31-58aedf792710 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:01.681844 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-3471dd5e-1137-49f6-8e31-58aedf792710 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Dec 20 03:22:01.682240 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 20/38] 10.222.0.53 () {56 vars in 1074 bytes} [Mon Dec 20 03:22:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:22:01.883386 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-95009028-1405-4f86-a459-e1435788b993 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:01.889116 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.wsgi [None req-95009028-1405-4f86-a459-e1435788b993 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 20 03:22:01.889715 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-95009028-1405-4f86-a459-e1435788b993 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:22:01.890523 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-95009028-1405-4f86-a459-e1435788b993 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.065567 Dec 20 03:22:01.891062 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 19/39] 10.222.0.53 () {60 vars in 1190 bytes} [Mon Dec 20 03:22:01 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 20 03:22:01.901347 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-c88be12b-8a9b-4819-8327-1e19fc2690c1 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:01.922146 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-c88be12b-8a9b-4819-8327-1e19fc2690c1 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024310 Dec 20 03:22:01.922741 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 21/40] 10.222.0.53 () {60 vars in 1210 bytes} [Mon Dec 20 03:22:01 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:22:01.933697 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-d31eedf9-7213-4e2d-a592-5cb5d466c932 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:01.954964 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-d31eedf9-7213-4e2d-a592-5cb5d466c932 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024722 Dec 20 03:22:01.956102 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 20/41] 10.222.0.53 () {60 vars in 1210 bytes} [Mon Dec 20 03:22:01 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:22:01.967050 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-5601746c-3840-4fd7-a753-89e124397d29 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:01.973425 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.wsgi [None req-5601746c-3840-4fd7-a753-89e124397d29 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 20 03:22:01.973998 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-5601746c-3840-4fd7-a753-89e124397d29 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:22:01.974795 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-5601746c-3840-4fd7-a753-89e124397d29 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011766 Dec 20 03:22:01.975320 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 22/42] 10.222.0.53 () {60 vars in 1190 bytes} [Mon Dec 20 03:22:01 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 20 03:22:03.517321 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-d31eedf9-7213-4e2d-a592-5cb5d466c932 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:03.519027 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-d31eedf9-7213-4e2d-a592-5cb5d466c932 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002213 Dec 20 03:22:03.519447 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 21/43] 10.222.0.53 () {56 vars in 1074 bytes} [Mon Dec 20 03:22:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:22:03.733099 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-cee43fcc-1b1f-4e46-ae04-adab2e73a3e0 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:03.739494 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.wsgi [None req-cee43fcc-1b1f-4e46-ae04-adab2e73a3e0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 20 03:22:03.740047 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-cee43fcc-1b1f-4e46-ae04-adab2e73a3e0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:22:03.740819 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-cee43fcc-1b1f-4e46-ae04-adab2e73a3e0 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.067155 Dec 20 03:22:03.741355 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 23/44] 10.222.0.53 () {60 vars in 1190 bytes} [Mon Dec 20 03:22:03 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 20 03:22:03.751150 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-b731ab9f-a0d1-4f14-99c1-50b4ee84bbdc admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:03.765015 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-b731ab9f-a0d1-4f14-99c1-50b4ee84bbdc admin admin] 10.222.0.53 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017306 Dec 20 03:22:03.765579 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 22/45] 10.222.0.53 () {60 vars in 1210 bytes} [Mon Dec 20 03:22:03 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:22:03.775543 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-7be9a275-53d4-4d88-8db2-f719e8e17420 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:03.790628 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-7be9a275-53d4-4d88-8db2-f719e8e17420 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018442 Dec 20 03:22:03.793197 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 24/46] 10.222.0.53 () {60 vars in 1210 bytes} [Mon Dec 20 03:22:03 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:22:03.802773 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-d198b60f-5595-4887-84f1-6d128fae97c1 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:03.808778 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.wsgi [None req-d198b60f-5595-4887-84f1-6d128fae97c1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 20 03:22:03.809505 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-d198b60f-5595-4887-84f1-6d128fae97c1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:22:03.810558 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-d198b60f-5595-4887-84f1-6d128fae97c1 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012442 Dec 20 03:22:03.811258 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 23/47] 10.222.0.53 () {60 vars in 1190 bytes} [Mon Dec 20 03:22:03 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 20 03:22:05.331091 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-7be9a275-53d4-4d88-8db2-f719e8e17420 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:05.332079 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-7be9a275-53d4-4d88-8db2-f719e8e17420 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002244 Dec 20 03:22:05.332483 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 25/48] 10.222.0.53 () {56 vars in 1074 bytes} [Mon Dec 20 03:22:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:22:05.527641 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-8b8ad7d6-0e66-4a52-86d6-0f9e080bf50e admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:05.532909 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.wsgi [None req-8b8ad7d6-0e66-4a52-86d6-0f9e080bf50e admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 20 03:22:05.534267 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-8b8ad7d6-0e66-4a52-86d6-0f9e080bf50e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:22:05.535072 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-8b8ad7d6-0e66-4a52-86d6-0f9e080bf50e admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.064457 Dec 20 03:22:05.535604 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 24/49] 10.222.0.53 () {60 vars in 1193 bytes} [Mon Dec 20 03:22:05 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 20 03:22:05.545727 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-c9d7d0f6-c3eb-434c-8087-1b5f64b33bac admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:05.559560 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-c9d7d0f6-c3eb-434c-8087-1b5f64b33bac admin admin] 10.222.0.53 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017462 Dec 20 03:22:05.560105 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 26/50] 10.222.0.53 () {60 vars in 1210 bytes} [Mon Dec 20 03:22:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:22:05.572155 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-e3dbbc98-78a0-485c-97c5-ff282f879e65 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:05.586745 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-e3dbbc98-78a0-485c-97c5-ff282f879e65 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019779 Dec 20 03:22:05.587336 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 25/51] 10.222.0.53 () {60 vars in 1210 bytes} [Mon Dec 20 03:22:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:22:05.598085 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-5fb2c124-141e-43bc-96d2-97ed374a5d2a admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:05.603959 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.wsgi [None req-5fb2c124-141e-43bc-96d2-97ed374a5d2a admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 20 03:22:05.604513 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-5fb2c124-141e-43bc-96d2-97ed374a5d2a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:22:05.605327 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-5fb2c124-141e-43bc-96d2-97ed374a5d2a admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011400 Dec 20 03:22:05.606391 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 27/52] 10.222.0.53 () {60 vars in 1193 bytes} [Mon Dec 20 03:22:05 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 20 03:22:07.119908 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-e3dbbc98-78a0-485c-97c5-ff282f879e65 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:07.120897 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-e3dbbc98-78a0-485c-97c5-ff282f879e65 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Dec 20 03:22:07.121321 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 26/53] 10.222.0.53 () {56 vars in 1074 bytes} [Mon Dec 20 03:22:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:22:07.317612 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-85aa1384-fba5-488a-84d4-896565dd9ea4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:22:07.400742 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-85aa1384-fba5-488a-84d4-896565dd9ea4 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.136297 Dec 20 03:22:07.401323 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 28/54] 10.222.0.53 () {64 vars in 1235 bytes} [Mon Dec 20 03:22:07 2021] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:22:08.953631 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-e3dbbc98-78a0-485c-97c5-ff282f879e65 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:08.954626 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-e3dbbc98-78a0-485c-97c5-ff282f879e65 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Dec 20 03:22:08.955024 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 27/55] 10.222.0.53 () {56 vars in 1074 bytes} [Mon Dec 20 03:22:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:22:09.149169 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-6368bbce-5c53-43f5-81c6-352a4243945c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:22:09.234270 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-6368bbce-5c53-43f5-81c6-352a4243945c admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.136943 Dec 20 03:22:09.234857 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 29/56] 10.222.0.53 () {64 vars in 1235 bytes} [Mon Dec 20 03:22:09 2021] POST /compute/v2.1/flavors => generated 405 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:22:10.775553 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-e3dbbc98-78a0-485c-97c5-ff282f879e65 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:10.776582 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-e3dbbc98-78a0-485c-97c5-ff282f879e65 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Dec 20 03:22:10.776980 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 28/57] 10.222.0.53 () {56 vars in 1074 bytes} [Mon Dec 20 03:22:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:22:10.971170 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-ac225ecc-effa-4c63-af70-8f2422268da0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:22:11.060275 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-ac225ecc-effa-4c63-af70-8f2422268da0 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.143250 Dec 20 03:22:11.060824 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 30/58] 10.222.0.53 () {64 vars in 1235 bytes} [Mon Dec 20 03:22:10 2021] POST /compute/v2.1/flavors => generated 407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:22:12.573400 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-e3dbbc98-78a0-485c-97c5-ff282f879e65 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:12.574401 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-e3dbbc98-78a0-485c-97c5-ff282f879e65 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Dec 20 03:22:12.574800 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 29/59] 10.222.0.53 () {56 vars in 1074 bytes} [Mon Dec 20 03:22:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:22:12.781462 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-9fb2ca8f-ad19-42e8-b21d-7ce53205916e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:22:12.891706 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-9fb2ca8f-ad19-42e8-b21d-7ce53205916e admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.170776 Dec 20 03:22:12.892267 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 31/60] 10.222.0.53 () {64 vars in 1235 bytes} [Mon Dec 20 03:22:12 2021] POST /compute/v2.1/flavors => generated 409 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:22:14.412285 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-e3dbbc98-78a0-485c-97c5-ff282f879e65 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:14.413308 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-e3dbbc98-78a0-485c-97c5-ff282f879e65 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Dec 20 03:22:14.413698 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 30/61] 10.222.0.53 () {56 vars in 1074 bytes} [Mon Dec 20 03:22:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:22:14.606157 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-b7ca2483-b13e-4810-b9a2-8682a541bd45 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:22:14.626469 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-b7ca2483-b13e-4810-b9a2-8682a541bd45 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073615 Dec 20 03:22:14.626950 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 32/62] 10.222.0.53 () {60 vars in 1202 bytes} [Mon Dec 20 03:22:14 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:23:03.759987 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-e3dbbc98-78a0-485c-97c5-ff282f879e65 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:23:03.761002 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-e3dbbc98-78a0-485c-97c5-ff282f879e65 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Dec 20 03:23:03.761446 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 31/63] 10.222.0.53 () {54 vars in 930 bytes} [Mon Dec 20 03:23:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:23:03.821422 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-9d1852cb-0104-4ba4-a7cc-f4be3145187e admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:23:03.842858 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-9d1852cb-0104-4ba4-a7cc-f4be3145187e admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074512 Dec 20 03:23:03.844335 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 33/64] 10.222.0.53 () {60 vars in 1291 bytes} [Mon Dec 20 03:23:03 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:23:03.866841 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-08fbe4a7-d074-48cc-a1b0-1332754096ff admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:23:03.874554 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-08fbe4a7-d074-48cc-a1b0-1332754096ff admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011550 Dec 20 03:23:03.875910 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 32/65] 10.222.0.53 () {60 vars in 1282 bytes} [Mon Dec 20 03:23:03 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:23:03.887559 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-55c37195-5c69-417e-9db7-cb6e028783a1 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:23:03.896273 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-55c37195-5c69-417e-9db7-cb6e028783a1 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012257 Dec 20 03:23:03.896816 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 34/66] 10.222.0.53 () {60 vars in 1285 bytes} [Mon Dec 20 03:23:03 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:23:03.909268 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-5bf775e2-7986-489d-8a0f-48bdc37a7075 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:23:03.916997 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-5bf775e2-7986-489d-8a0f-48bdc37a7075 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011919 Dec 20 03:23:03.917567 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 33/67] 10.222.0.53 () {60 vars in 1285 bytes} [Mon Dec 20 03:23:03 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:23:03.929472 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-fea9f371-ab1a-4e2b-9418-71d931698187 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:23:03.937826 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-fea9f371-ab1a-4e2b-9418-71d931698187 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011756 Dec 20 03:23:03.938346 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 35/68] 10.222.0.53 () {60 vars in 1282 bytes} [Mon Dec 20 03:23:03 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:25:07.625945 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-fc9d0cec-f6ee-442c-92f9-1a4ab0404b63 tempest-verify_tempest_config-330850806 tempest-verify_tempest_config-330850806-project] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:25:07.627952 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-fc9d0cec-f6ee-442c-92f9-1a4ab0404b63 tempest-verify_tempest_config-330850806 tempest-verify_tempest_config-330850806-project] 10.222.0.53 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.121023 Dec 20 03:25:07.628502 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 34/69] 10.222.0.53 () {58 vars in 1133 bytes} [Mon Dec 20 03:25:07 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:26:35.625594 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-fea9f371-ab1a-4e2b-9418-71d931698187 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:26:35.626598 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-fea9f371-ab1a-4e2b-9418-71d931698187 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Dec 20 03:26:35.627134 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 36/70] 10.222.0.53 () {56 vars in 1074 bytes} [Mon Dec 20 03:26:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:26:35.882059 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-6f162d99-1952-4fe0-85ed-36d89088ceb9 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:26:35.883232 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:26:35.883232 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: warnings.warn(msg) Dec 20 03:26:35.884830 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-6f162d99-1952-4fe0-85ed-36d89088ceb9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:26:35.885312 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-6f162d99-1952-4fe0-85ed-36d89088ceb9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:26:35.886116 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-6f162d99-1952-4fe0-85ed-36d89088ceb9 admin admin] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:26:35.886555 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-6f162d99-1952-4fe0-85ed-36d89088ceb9 admin admin] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:26:35.918785 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-6f162d99-1952-4fe0-85ed-36d89088ceb9 admin admin] 10.222.0.53 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.146314 Dec 20 03:26:35.919355 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 35/71] 10.222.0.53 () {60 vars in 1193 bytes} [Mon Dec 20 03:26:35 2021] GET /compute/v2.1/os-services => generated 794 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:26:37.412419 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-fea9f371-ab1a-4e2b-9418-71d931698187 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:26:37.413443 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-fea9f371-ab1a-4e2b-9418-71d931698187 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Dec 20 03:26:37.413837 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 37/72] 10.222.0.53 () {56 vars in 1074 bytes} [Mon Dec 20 03:26:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:26:37.610473 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-f06d27ba-6205-4481-9edb-d2b088d41f14 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:26:37.611643 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:26:37.611643 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: warnings.warn(msg) Dec 20 03:26:37.613180 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-f06d27ba-6205-4481-9edb-d2b088d41f14 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:26:37.613926 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-f06d27ba-6205-4481-9edb-d2b088d41f14 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:26:37.614763 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-f06d27ba-6205-4481-9edb-d2b088d41f14 admin admin] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:26:37.615195 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-f06d27ba-6205-4481-9edb-d2b088d41f14 admin admin] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:26:37.634573 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-f06d27ba-6205-4481-9edb-d2b088d41f14 admin admin] 10.222.0.53 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077876 Dec 20 03:26:37.635051 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 36/73] 10.222.0.53 () {60 vars in 1193 bytes} [Mon Dec 20 03:26:37 2021] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:26:49.588297 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-fea9f371-ab1a-4e2b-9418-71d931698187 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:26:49.589409 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-fea9f371-ab1a-4e2b-9418-71d931698187 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Dec 20 03:26:49.589802 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 38/74] 10.222.0.53 () {56 vars in 1074 bytes} [Mon Dec 20 03:26:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:26:49.788024 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-cf90199e-b019-4ecc-8009-fe467f1b5b7e admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:26:49.789233 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:26:49.789233 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: warnings.warn(msg) Dec 20 03:26:49.790741 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-cf90199e-b019-4ecc-8009-fe467f1b5b7e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:26:49.791186 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-cf90199e-b019-4ecc-8009-fe467f1b5b7e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:26:49.791989 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-cf90199e-b019-4ecc-8009-fe467f1b5b7e admin admin] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:26:49.792413 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-cf90199e-b019-4ecc-8009-fe467f1b5b7e admin admin] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:26:49.817776 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-cf90199e-b019-4ecc-8009-fe467f1b5b7e admin admin] 10.222.0.53 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.082805 Dec 20 03:26:49.818270 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 37/75] 10.222.0.53 () {60 vars in 1193 bytes} [Mon Dec 20 03:26:49 2021] GET /compute/v2.1/os-services => generated 1014 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:26:51.330108 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-fea9f371-ab1a-4e2b-9418-71d931698187 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:26:51.331102 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-fea9f371-ab1a-4e2b-9418-71d931698187 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Dec 20 03:26:51.331495 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 39/76] 10.222.0.53 () {56 vars in 1074 bytes} [Mon Dec 20 03:26:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:26:51.560154 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-031cb4be-f5eb-4965-ba51-441e9d121cda admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:26:51.562032 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:26:51.562032 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: warnings.warn(msg) Dec 20 03:26:51.563714 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-031cb4be-f5eb-4965-ba51-441e9d121cda admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:26:51.564165 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-031cb4be-f5eb-4965-ba51-441e9d121cda admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:26:51.565529 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-031cb4be-f5eb-4965-ba51-441e9d121cda admin admin] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:26:51.566288 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-031cb4be-f5eb-4965-ba51-441e9d121cda admin admin] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:26:51.590423 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-031cb4be-f5eb-4965-ba51-441e9d121cda admin admin] 10.222.0.53 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.092336 Dec 20 03:26:51.591011 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 38/77] 10.222.0.53 () {60 vars in 1193 bytes} [Mon Dec 20 03:26:51 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:27:49.683531 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: Mon Dec 20 03:27:49 2021 - graceful shutdown triggered... Dec 20 03:27:49.683666 dv-cinder-818037-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 20 03:27:49.684832 dv-cinder-818037-11-iscsi devstack@n-api.service[102581]: Gracefully killing worker 2 (pid: 102581)... Dec 20 03:27:49.685281 dv-cinder-818037-11-iscsi devstack@n-api.service[102580]: Gracefully killing worker 1 (pid: 102580)... Dec 20 03:27:50.685509 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: worker 1 buried after 1 seconds Dec 20 03:27:50.685509 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: worker 2 buried after 1 seconds Dec 20 03:27:50.685509 dv-cinder-818037-11-iscsi devstack@n-api.service[102579]: goodbye to uWSGI. Dec 20 03:27:50.687062 dv-cinder-818037-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 20 03:27:50.687609 dv-cinder-818037-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 20 03:27:50.690442 dv-cinder-818037-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 20 03:27:50.699652 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 20 03:27:50.701513 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Dec 20 03:27:50 2021] *** Dec 20 03:27:50.701513 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 20 03:27:50.701513 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 20 03:27:50.701513 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: nodename: dv-cinder-818037-11-iscsi Dec 20 03:27:50.701513 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: machine: x86_64 Dec 20 03:27:50.701513 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: clock source: unix Dec 20 03:27:50.701513 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: pcre jit disabled Dec 20 03:27:50.701513 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: detected number of CPU cores: 4 Dec 20 03:27:50.701513 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: current working directory: / Dec 20 03:27:50.701513 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: detected binary path: /usr/bin/uwsgi-core Dec 20 03:27:50.701513 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: your processes number limit is 47680 Dec 20 03:27:50.702224 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: your memory page size is 4096 bytes Dec 20 03:27:50.702224 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: detected max file descriptor number: 2048 Dec 20 03:27:50.702224 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: lock engine: pthread robust mutexes Dec 20 03:27:50.702224 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: thunder lock: enabled Dec 20 03:27:50.702224 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 20 03:27:50.702224 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 20 03:27:50.747517 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: Python main interpreter initialized at 0x558802e939c0 Dec 20 03:27:50.747517 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: python threads support enabled Dec 20 03:27:50.747517 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: your server socket listen backlog is limited to 100 connections Dec 20 03:27:50.747517 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: your mercy for graceful operations on workers is 90 seconds Dec 20 03:27:50.747942 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: mapped 403077 bytes (393 KB) for 2 cores Dec 20 03:27:50.747942 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: *** Operational MODE: preforking *** Dec 20 03:27:50.748246 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: *** uWSGI is running in multiple interpreter mode *** Dec 20 03:27:50.748246 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: spawned uWSGI master process (pid: 116996) Dec 20 03:27:50.748456 dv-cinder-818037-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 20 03:27:50.749126 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: spawned uWSGI worker 1 (pid: 117011, cores: 1) Dec 20 03:27:50.749438 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: spawned uWSGI worker 2 (pid: 117012, cores: 1) Dec 20 03:27:50.749623 dv-cinder-818037-11-iscsi devstack@n-api.service[116996]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 20 03:27:52.685013 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 20 03:27:52.685013 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: from cryptography.utils import int_from_bytes Dec 20 03:27:52.685759 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 20 03:27:52.685759 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: from cryptography.utils import int_from_bytes Dec 20 03:27:52.691054 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 20 03:27:52.691054 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: from cryptography.utils import int_from_bytes Dec 20 03:27:52.691575 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 20 03:27:52.691575 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: from cryptography.utils import int_from_bytes Dec 20 03:27:55.149548 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 20 03:27:55.150199 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 20 03:27:55.150544 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 20 03:27:55.150763 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 20 03:27:55.151018 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 20 03:27:55.151103 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 20 03:27:55.151190 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 20 03:27:55.151262 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 20 03:27:55.151339 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 20 03:27:55.151409 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 20 03:27:55.151482 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.151551 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.151630 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.151833 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.151948 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.152180 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.152293 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.152510 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.152612 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.152863 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.152968 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.153208 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.153326 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.153619 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.153708 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.153872 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.153972 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.154184 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.154292 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.154513 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.154616 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.154852 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-11-iscsi {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.155062 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.155243 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.155375 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-11-iscsi {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.155548 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.155646 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.155874 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.155989 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.156194 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.156305 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.156511 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.156618 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.157249 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.157351 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.157433 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.157512 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.157593 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.157670 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.158580 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.158786 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.158896 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.158972 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.159050 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.159127 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.159211 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.159291 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.159372 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.159445 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.159525 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.159801 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.159931 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.160020 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.160181 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.160312 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.160585 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.160714 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.160931 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.161045 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.161255 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.161433 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-11-iscsi {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.161732 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-11-iscsi {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.161858 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.161991 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.162105 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.162308 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.162414 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.162628 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.162792 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.163094 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.163301 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.163400 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.163600 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.163755 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.163937 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.164143 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.164283 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.164479 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.164591 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.164804 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.165010 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.165178 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.168265 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.168360 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.168461 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.168564 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.168657 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.168762 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.168862 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.168961 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.169052 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.169185 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.169274 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.169368 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.169452 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.169564 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.169650 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.169731 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.169814 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.169896 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.169978 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.170091 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.170186 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.170186 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.170368 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.170479 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.170578 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.170671 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.170767 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.170852 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.170942 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.171034 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.171132 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.171313 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.171420 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.171515 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.171611 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.171708 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.171794 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.171883 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.171974 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.172058 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.172160 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.172485 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.172635 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.172782 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.172926 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.173079 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.173402 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.173564 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.173699 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.173860 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.173993 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.174067 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.174147 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.174225 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.174296 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.174365 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.174434 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.174502 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.174586 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.174794 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.174794 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.53 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.175082 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.53 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.178240 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.178343 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.178343 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.178592 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.178592 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.178733 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.53 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.178814 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.178885 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.53 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.178966 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.179048 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.179126 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.179196 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.179265 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.179748 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.179848 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.179944 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.180029 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.180120 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.180204 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.180298 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.180384 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.180476 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.180568 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.180660 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.180744 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.180840 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.180926 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.180926 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.181093 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.181219 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.181303 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.181384 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.181463 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.181463 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.181612 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.181765 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.181846 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.181846 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.181982 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.182057 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.182127 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.182196 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.182416 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.182534 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.182617 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.182699 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.182804 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.182990 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.183086 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.183212 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.183408 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.183526 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.183721 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.183814 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.183999 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.184169 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.184294 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.184425 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.184556 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.184704 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.184837 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.184968 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.185246 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.185435 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.185577 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.185730 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.185891 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.185992 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.186221 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.186315 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.186544 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.186643 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.186861 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.186954 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.187180 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.187318 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.187495 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.187595 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.187811 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.187917 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.188139 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.188261 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.188611 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.188711 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.188805 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.188890 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.189072 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.189212 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.191246 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.191403 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.191494 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.191635 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.191724 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.191814 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.191924 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.192010 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.192100 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.192194 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.192285 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.192381 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.192464 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.192623 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.192708 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.192806 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.192896 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.192996 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.193088 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.193268 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.193360 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.193442 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.193524 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.193667 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.193764 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.193856 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.193939 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.194548 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.194663 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.194757 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.194830 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.194955 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.195076 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.195197 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.195330 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.195465 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.195603 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.195736 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.195939 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.196034 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.196261 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.196363 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.196581 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.196681 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.196900 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.196999 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.197277 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 03:27:55.197377 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.197597 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.197701 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.197918 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.198022 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.198248 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.198358 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.198584 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.198683 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.198909 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.199010 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.199233 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.199338 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.199557 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.199653 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.199888 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.200021 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.200217 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.200371 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.200563 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.200697 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.200877 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.201008 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.201225 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.201335 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.201557 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.201670 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.201883 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.202002 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.202214 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.202321 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.202551 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.202651 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.202886 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.203218 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.203566 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.203709 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.203915 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.204082 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.204236 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.204395 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.204572 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.204676 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.204896 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.205003 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.205289 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.205404 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.205575 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.205680 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.205951 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.206059 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.206209 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.206565 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.206665 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.206891 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.206999 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.207213 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.207329 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.207568 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.207674 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.207888 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.207998 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.208211 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.208320 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.208533 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.208632 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.208857 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.208966 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.209192 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.209306 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.209519 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.209625 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.210468 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.210569 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.210813 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.210991 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.211155 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.211312 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.211514 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.211644 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.211846 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.212044 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.212185 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.212274 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.212479 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.212579 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.212798 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.212905 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.213119 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.213233 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.213458 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.213571 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.213793 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.213893 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.214134 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.214235 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.214450 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.214556 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.214792 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.214898 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.215106 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.215204 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.215426 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.215535 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.215744 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.215842 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.216059 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.216158 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.216383 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.216573 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.216736 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.216884 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.217026 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.217196 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.217356 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.217525 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.217767 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.217923 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.218076 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.218242 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.218400 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.218552 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.218701 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.218843 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.219011 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.219153 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.219314 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.219463 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.219603 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.219743 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.219883 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.220057 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.220223 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.220375 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.220534 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.220679 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.220849 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.221002 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.221206 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.221362 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.221513 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.221655 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.221794 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.221934 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.222082 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.222266 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.222412 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.222602 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.222756 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.222906 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.223047 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.223189 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.223375 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.223531 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.223679 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.223844 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.223992 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.224703 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.224869 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.225010 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.225220 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.225504 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.225690 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.225848 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.226150 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.226301 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.226470 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.226721 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.226870 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.227026 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.227176 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.227330 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.227516 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.227677 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.227827 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.227969 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.228109 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.228249 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.228403 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.228587 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.228779 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.228937 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.229087 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.229346 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.229547 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.229703 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.229853 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.230005 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.230146 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.230293 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.230443 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.230636 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.230789 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.230960 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.231111 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.231262 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.231423 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.231611 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.231758 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.231901 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.232040 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.232189 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.232343 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.232485 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.232633 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.232778 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.232927 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.233082 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.233252 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.233405 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.233557 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.233699 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.233848 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.233999 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.234141 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.234798 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.234960 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.235106 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.235365 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.235524 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.235701 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.235885 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.236044 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.236194 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.236344 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.236486 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.236626 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.236921 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.237078 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.237310 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.237464 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.237606 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.237754 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.237929 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.238115 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.238270 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.238496 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.238679 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.238836 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.239013 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.239154 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.239305 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.239460 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.239601 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.239748 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.239888 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.240062 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.240221 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.240392 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.241372 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.241532 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.241676 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.241817 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.241972 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.242149 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.242296 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.242437 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.242584 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.242738 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.242893 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.243052 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.243195 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.243374 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.243525 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.243723 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.243877 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.244027 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.244212 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.244375 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.244948 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.245116 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.245571 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.245733 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.245899 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.246041 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.246181 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.246366 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.246512 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.246661 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.246946 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.247195 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.247377 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.247542 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.247694 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.247891 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.248052 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.248205 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.248346 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.248494 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.248636 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.248776 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.248964 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.249125 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.249352 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.249511 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.249653 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.249793 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.249933 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.250121 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.250287 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.250438 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.250634 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.250800 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.250950 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.251091 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.251240 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.251381 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.251567 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.251721 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.251863 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.252004 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.252197 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.252361 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.252517 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.252667 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.252816 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.252965 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.253115 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.253293 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.253437 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.253576 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.253724 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.253878 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.254027 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.254232 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.254379 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.254521 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.255089 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.255253 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.255405 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.255596 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.255833 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.255987 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.256137 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.256331 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.256485 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.257115 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.265706 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.266010 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.266174 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.266335 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.266524 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.266673 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.266814 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.266961 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.267112 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.267279 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.267496 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.267756 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.267906 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.268060 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.268212 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.268353 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.268493 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.268634 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.268634 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.268909 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.269060 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.269229 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.269389 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.269540 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.269682 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.269829 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.269996 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.270264 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.270428 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.270616 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.270862 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.271025 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.271168 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.271309 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.271309 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.271582 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.271759 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.271916 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.272069 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.272235 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.272988 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.273216 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.273407 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.273597 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.273750 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.273893 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.274034 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.274182 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.274332 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.274482 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.274674 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.274850 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.275428 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.275579 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.275736 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.275879 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.276044 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.276287 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.276434 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.276580 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.276736 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.276891 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.277042 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.277222 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.277399 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.277543 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.277698 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.277958 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.278104 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.278254 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.278395 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.278535 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.278682 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.278837 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.278978 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.279209 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.279363 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.279505 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.279653 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.279855 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.280003 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.280146 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.280294 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.280458 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.280618 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.280761 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.280993 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.281191 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.281366 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.281522 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.281720 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.281864 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.282005 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.282154 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.282296 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.282436 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.282584 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.282771 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.282926 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.283098 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.283408 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.283573 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.283745 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.283889 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.284179 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.284328 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.284478 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.284633 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.284784 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.284933 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.285100 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.285632 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.285798 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.286019 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.286179 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.286336 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.286575 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.286731 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.286880 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.287069 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.287215 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.287369 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.287519 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.287671 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.287839 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.288164 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.288314 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.288474 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.288692 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.288841 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.289029 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.289248 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.289396 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.289550 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.289711 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.289854 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.290037 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.290193 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.290342 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.290485 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.290645 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.290846 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.291021 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.291296 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.291453 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.291595 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.291744 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.291918 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.292079 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.292229 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.292371 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.292512 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.292652 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.292819 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.292972 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.293121 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.293359 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.293514 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.293665 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.293822 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.293970 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.294120 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.294372 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.294521 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.294669 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.294821 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.294977 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.295118 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.295265 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.295852 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.296010 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.296174 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.296323 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.296471 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.296757 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.296916 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.297075 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.297299 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.297511 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.297674 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.297864 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.298021 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.298296 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.298461 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.298621 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.298770 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.298968 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.299123 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.299281 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.299442 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.299596 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.299756 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.299946 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.300109 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.300272 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.300427 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.300583 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.300739 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.300886 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.301054 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.301240 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.301240 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.301631 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.301788 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.301994 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.301994 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.302297 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.302445 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.302600 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.302761 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.302920 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.303115 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.303268 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.303452 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.303607 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.303781 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.304014 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.304195 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.304366 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.304605 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.304767 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.304923 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.305088 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.305289 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.305448 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.307282 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.307458 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.307458 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.307774 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.307932 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.308129 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.308300 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.308634 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.308803 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.308968 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.309118 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.309293 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.309459 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.309618 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.309774 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.309933 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.310090 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.310239 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.310404 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.310555 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.310702 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.310862 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.311017 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.311204 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.311360 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.311622 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.311858 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.312018 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.312199 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.312350 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.312509 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.312667 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.312829 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.312985 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.313215 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.313373 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.313533 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.313691 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.313848 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.313996 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.314143 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.314290 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.314444 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.314628 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.314944 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.315145 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.315301 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.315458 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.315614 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.316255 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.316413 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.316563 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.316717 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.316868 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.317023 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.317205 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.317493 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.317658 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.317808 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.317969 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.318118 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.318274 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.318429 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.318595 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.318851 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.319017 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.319017 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.320062 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.320245 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.320398 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.320623 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.320789 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.320947 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.321097 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.321301 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.321461 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.321650 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.321885 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.322105 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.322263 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.322421 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.322581 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.322736 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.322883 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.323095 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.323287 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.323440 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.323595 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.323743 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.323899 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.324069 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.324218 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.324412 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.324565 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.324727 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.324913 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.325173 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.325332 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.325481 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.325627 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.325783 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.326344 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.326344 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.326767 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.326923 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.327081 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.327238 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.327416 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.327576 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.327750 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.327996 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.328150 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.328150 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.328450 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.328599 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.328744 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.329013 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.329212 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.329381 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.329550 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.329708 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.329857 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.330004 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.330160 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.330323 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.330479 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.330635 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.330783 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.330938 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.331087 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.331244 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.331438 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.331600 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.331748 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.331930 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.332170 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.332170 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.332520 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.332520 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.332816 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.332971 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.333150 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.333309 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.333471 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.333471 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.333800 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.333949 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.334111 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.334111 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.334401 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.334557 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.334738 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.335522 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.335692 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.335850 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.336024 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.336618 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.336795 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.336956 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.337104 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.337294 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.337461 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.337611 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.337767 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.337926 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.338216 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.338389 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.338626 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.338786 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.338950 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.339301 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.339498 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.339498 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.339803 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.339968 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.340133 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.340282 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.340430 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.340620 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.340916 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.341096 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.341316 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.341464 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.341623 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.341792 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.341944 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.342105 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.342380 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.342536 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.342692 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.342848 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.343004 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.343163 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.343313 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.343460 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.343607 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.343778 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.343937 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.344086 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.344234 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.344388 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.344537 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.344692 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.344848 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.344996 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.345172 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.345543 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.345715 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.345884 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.346045 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.346203 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.346874 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.347043 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.347240 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.347402 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.347596 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.347750 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.347906 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.348062 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.348230 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.348511 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.348737 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.348901 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.349065 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.349253 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.349509 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.349509 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.349852 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.350000 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.350147 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.350147 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.350462 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.350462 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.350914 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.350914 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.351221 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.351378 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.351528 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.351684 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.351833 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.351988 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.352137 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.352293 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.352576 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.353373 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.353537 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.353697 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.353855 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.354002 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.354163 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.354320 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.354476 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.354634 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.354790 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.354939 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.355152 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.355358 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.355513 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.355753 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.355927 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.356076 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.356234 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.356390 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.356801 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.357100 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.357282 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.357444 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.357595 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.357818 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.357970 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.358117 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.358264 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.358432 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.358694 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.358850 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.359006 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.359154 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.359301 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.359301 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.359753 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.359918 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.360067 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.360215 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.360362 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.360520 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.360687 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.360862 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.361598 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.361761 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.361923 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.362074 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.362221 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.362370 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.362543 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.362780 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.362943 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.363107 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.363266 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.363434 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.363629 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.363783 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.363941 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.364100 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.364249 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.364405 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.364555 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.364747 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.364911 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.365069 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.365271 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.365432 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.365590 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.365766 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.366275 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.366477 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.366652 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.367221 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.367379 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.367551 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.367700 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.367855 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.368019 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.368169 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.368333 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.368492 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.368654 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.368931 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.369092 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.369277 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.369452 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.369601 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.369773 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.370035 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.370188 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.370473 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.370680 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.370842 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.370992 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.371139 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.371286 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.371483 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.371650 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.371800 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.371954 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.372104 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.372259 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.372492 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.372653 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.372821 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.373057 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.373284 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.373437 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.373603 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.373753 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.373902 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.374048 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.374202 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.374363 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.374527 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.374686 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.374845 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.375052 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.375220 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.375382 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.375556 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.375719 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.375868 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.376016 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.376178 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.376430 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.376595 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.376755 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.377320 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.377482 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.377645 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.377802 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.377959 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.378118 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.378281 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.378430 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.378587 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.378745 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.378745 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.379207 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.379207 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.379516 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.379704 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.379859 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.380033 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.380278 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.380441 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.380604 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.380755 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.380946 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.381102 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.381288 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.381453 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.382124 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.382323 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.382571 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.382822 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.382992 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.382992 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.383414 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.383694 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.383865 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.384018 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.384181 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.384344 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.384506 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.384662 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.385599 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.385769 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.385928 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.386094 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.386246 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.386414 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.386659 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.386816 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.386995 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.387553 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.387745 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.387896 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.388044 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.388203 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.388352 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.388352 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.388645 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.388847 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.389007 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.389358 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.389531 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.389684 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.389833 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.389993 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.390142 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.390311 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.390583 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.390583 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.390872 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.391028 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.391177 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.391325 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.391483 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.391638 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.391787 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.391941 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.392110 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.392258 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.392417 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.392566 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.392718 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.392866 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.393013 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.393223 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.393464 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.394157 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.394327 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.394485 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.394654 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.394814 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.394972 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.395120 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.395120 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.395409 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.395409 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.395409 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.395881 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.396059 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.396207 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.396361 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.396510 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.396704 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.396971 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.397146 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.397754 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.397917 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.398085 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.398243 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.398409 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.398558 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.398707 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.398871 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.399038 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.399189 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.399383 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.399684 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.399852 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.400003 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.400165 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.400315 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.400315 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.400603 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.400753 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.400907 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.401070 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.401359 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.401515 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.401685 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.401685 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.402020 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.402170 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.402325 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.402325 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.402615 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.402763 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.402921 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.403077 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.403226 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.403380 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.403658 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.403828 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.403985 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.404143 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.404143 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.404425 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.404581 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.404736 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.404899 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.405048 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.405230 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.405385 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.405533 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.405703 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.405860 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.406016 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.406163 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.406318 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.406474 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.406633 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.406633 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.406941 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.406941 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.407321 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.407321 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.408013 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.408187 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.408343 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.408501 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.408649 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.408811 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.408961 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.409114 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.409296 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.409448 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.409596 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.409933 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.410092 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.410261 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.410410 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.410565 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.410715 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.410715 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.411006 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.411163 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.411320 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.411583 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.411743 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.411942 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.412103 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.412253 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.412410 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.412565 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.412728 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.412909 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.412909 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.412909 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.412909 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.412909 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.412909 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.412909 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.412909 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.414337 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.414505 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.414655 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.414813 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.414813 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.414813 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.414813 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.414813 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.415528 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.415677 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.415824 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.415973 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.416121 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.416121 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.416421 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.416570 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.416731 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.416880 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.417035 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.417219 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.417585 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.418205 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.418959 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.419124 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.419300 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.419451 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.419601 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.419759 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.420269 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.420427 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.420427 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.420427 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.420427 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.420427 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.421164 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.421321 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.421483 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.421822 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.421822 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.422131 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.422281 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.422436 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.422593 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.422744 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.422899 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.423062 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.423212 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.423372 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.423522 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.423681 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.423947 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.424117 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.424269 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.424418 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.424566 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.424566 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.424868 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.425025 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.425203 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.425366 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.425516 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.425665 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.425837 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.426007 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.426007 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.426298 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.426446 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.426593 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.426753 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.426913 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.427063 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.427211 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.427508 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.427778 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.429013 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.429269 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.429436 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.429598 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.429755 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.429914 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.430066 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.430214 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.430370 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.430658 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.430829 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.430989 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.431142 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.431310 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.431460 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.431609 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.431757 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.431938 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.432095 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.432246 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.432400 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.432548 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.432710 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.432869 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.433024 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.433192 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.433370 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.433523 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.433686 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.433825 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.434102 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.434241 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.434378 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.434512 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.434666 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.434803 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.434948 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.435103 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.435264 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.435264 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.435454 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.435540 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.436237 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.436385 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.436483 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.436577 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.436671 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.436755 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.436837 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.436926 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.437018 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.437110 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.437303 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.437395 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.437534 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.437623 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.437714 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.437859 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 20 03:27:55.437996 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.437996 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.437996 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.437996 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.437996 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.437996 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 03:27:55.437996 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 20 03:27:55.438983 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_db.sqlalchemy.engines [None req-1cb75c09-781b-44c0-9f7e-eeb365c64d4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 03:27:55.439072 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_db.sqlalchemy.engines [None req-c457e605-f38f-4d9f-ac0c-af0d7acac520 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 03:27:55.507439 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.context [None req-c457e605-f38f-4d9f-ac0c-af0d7acac520 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aee21a6b-374f-4375-aa47-f4018ba93cc8(cell1) {{(pid=117011) load_cells /opt/stack/nova/nova/context.py:464}} Dec 20 03:27:55.508599 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.context [None req-1cb75c09-781b-44c0-9f7e-eeb365c64d4e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aee21a6b-374f-4375-aa47-f4018ba93cc8(cell1) {{(pid=117012) load_cells /opt/stack/nova/nova/context.py:464}} Dec 20 03:27:55.511963 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c457e605-f38f-4d9f-ac0c-af0d7acac520 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:27:55.512977 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1cb75c09-781b-44c0-9f7e-eeb365c64d4e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:27:55.513713 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c457e605-f38f-4d9f-ac0c-af0d7acac520 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:27:55.514537 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c457e605-f38f-4d9f-ac0c-af0d7acac520 None None] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:27:55.514658 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1cb75c09-781b-44c0-9f7e-eeb365c64d4e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:27:55.515482 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1cb75c09-781b-44c0-9f7e-eeb365c64d4e None None] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:27:55.516596 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c457e605-f38f-4d9f-ac0c-af0d7acac520 None None] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:27:55.517524 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1cb75c09-781b-44c0-9f7e-eeb365c64d4e None None] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:27:55.530003 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_db.sqlalchemy.engines [None req-c457e605-f38f-4d9f-ac0c-af0d7acac520 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 03:27:55.531347 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_db.sqlalchemy.engines [None req-c457e605-f38f-4d9f-ac0c-af0d7acac520 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 03:27:55.532643 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_db.sqlalchemy.engines [None req-1cb75c09-781b-44c0-9f7e-eeb365c64d4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 03:27:55.535434 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_db.sqlalchemy.engines [None req-1cb75c09-781b-44c0-9f7e-eeb365c64d4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 03:27:55.696106 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_db.sqlalchemy.engines [None req-c457e605-f38f-4d9f-ac0c-af0d7acac520 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 03:27:55.702508 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_db.sqlalchemy.engines [None req-1cb75c09-781b-44c0-9f7e-eeb365c64d4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 03:27:56.027034 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: WARNING keystonemiddleware.auth_token [None req-c457e605-f38f-4d9f-ac0c-af0d7acac520 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 20 03:27:56.029950 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: WARNING keystonemiddleware.auth_token [None req-1cb75c09-781b-44c0-9f7e-eeb365c64d4e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 20 03:27:56.033597 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: WARNING keystonemiddleware.auth_token [None req-c457e605-f38f-4d9f-ac0c-af0d7acac520 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 20 03:27:56.036546 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: WARNING keystonemiddleware.auth_token [None req-1cb75c09-781b-44c0-9f7e-eeb365c64d4e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 20 03:27:56.379711 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: WARNING keystonemiddleware.auth_token [None req-c457e605-f38f-4d9f-ac0c-af0d7acac520 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 20 03:27:56.382809 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: WARNING keystonemiddleware.auth_token [None req-1cb75c09-781b-44c0-9f7e-eeb365c64d4e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 20 03:27:56.385694 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: WARNING keystonemiddleware.auth_token [None req-c457e605-f38f-4d9f-ac0c-af0d7acac520 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 20 03:27:56.388005 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: WARNING keystonemiddleware.auth_token [None req-1cb75c09-781b-44c0-9f7e-eeb365c64d4e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 20 03:27:56.391048 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558802e939c0 pid: 117011 (default app) Dec 20 03:27:56.393319 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558802e939c0 pid: 117012 (default app) Dec 20 03:28:32.780524 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-2467ad85-8f45-497e-9370-76648b656782 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] Action: 'create', calling method: .version_select at 0x7f4905864e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-498652527", "metadata": {"Type": "work"}}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:28:32.782969 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-2467ad85-8f45-497e-9370-76648b656782 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:28:32.784091 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-2467ad85-8f45-497e-9370-76648b656782 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] 10.222.0.53 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.868878 Dec 20 03:28:32.785128 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 1/1] 10.222.0.53 () {60 vars in 1155 bytes} [Mon Dec 20 03:28:31 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 872 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 20 03:28:32.796653 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a75ca138-48fb-437c-9617-586af30f5ce1 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] Action: 'create', calling method: .version_select at 0x7f49057929d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-88060369", "metadata": {"Type": "work"}}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:28:32.799563 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a75ca138-48fb-437c-9617-586af30f5ce1 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:28:32.800655 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a75ca138-48fb-437c-9617-586af30f5ce1 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] 10.222.0.53 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009081 Dec 20 03:28:32.801756 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 2/2] 10.222.0.53 () {60 vars in 1155 bytes} [Mon Dec 20 03:28:32 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 20 03:28:32.812454 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-cce971cb-75e4-4db4-b809-2854d98fdf21 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] Action: 'create', calling method: .version_select at 0x7f4905792940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1295770146", "metadata": {"Type": "work"}}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:28:32.814910 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-cce971cb-75e4-4db4-b809-2854d98fdf21 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:28:32.816235 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-cce971cb-75e4-4db4-b809-2854d98fdf21 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] 10.222.0.53 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008475 Dec 20 03:28:32.817513 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 3/3] 10.222.0.53 () {60 vars in 1155 bytes} [Mon Dec 20 03:28:32 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 20 03:28:32.827411 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-667d03a1-5fe7-40bc-9747-8664bc3fdef0 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] Calling method '.version_select at 0x7f49057fd430>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:33.167112 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-8f109804-228b-4368-be90-22710c193464 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Action: 'create', calling method: .version_select at 0x7f490585aee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1174641713"}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:28:33.360168 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-667d03a1-5fe7-40bc-9747-8664bc3fdef0 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] HTTP exception thrown: Volume tempest-invalid-653251753 could not be found. Dec 20 03:28:33.360706 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-667d03a1-5fe7-40bc-9747-8664bc3fdef0 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] Returning 404 to user: Volume tempest-invalid-653251753 could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:28:33.361901 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-667d03a1-5fe7-40bc-9747-8664bc3fdef0 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] 10.222.0.53 "DELETE /compute/v2.1/os-volumes/tempest-invalid-653251753" status: 404 len: 98 microversion: 2.1 time: 0.538616 Dec 20 03:28:33.362961 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 4/4] 10.222.0.53 () {58 vars in 1214 bytes} [Mon Dec 20 03:28:32 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-653251753 => generated 98 bytes in 540 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 20 03:28:33.375117 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-81857f44-3de5-4f35-bf3f-e75201eb48b7 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] 10.222.0.53 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005284 Dec 20 03:28:33.376106 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 5/5] 10.222.0.53 () {58 vars in 1139 bytes} [Mon Dec 20 03:28:33 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 20 03:28:33.384541 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-19e4ca94-06f3-4636-ad40-ac326855e4ab tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003544 Dec 20 03:28:33.389540 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 6/6] 10.222.0.53 () {58 vars in 1136 bytes} [Mon Dec 20 03:28:33 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 20 03:28:33.394276 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-fc760166-ef1c-4aa5-9282-efe040594d01 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] Calling method '.version_select at 0x7f4905744f70>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:33.577063 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-fc760166-ef1c-4aa5-9282-efe040594d01 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] HTTP exception thrown: Volume 0449e758-eff8-4fb1-985a-a83bcb4fbd2a could not be found. Dec 20 03:28:33.577958 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-fc760166-ef1c-4aa5-9282-efe040594d01 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] Returning 404 to user: Volume 0449e758-eff8-4fb1-985a-a83bcb4fbd2a could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:28:33.579097 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-fc760166-ef1c-4aa5-9282-efe040594d01 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] 10.222.0.53 "DELETE /compute/v2.1/os-volumes/0449e758-eff8-4fb1-985a-a83bcb4fbd2a" status: 404 len: 109 microversion: 2.1 time: 0.188388 Dec 20 03:28:33.579877 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 7/7] 10.222.0.53 () {58 vars in 1247 bytes} [Mon Dec 20 03:28:33 2021] DELETE /compute/v2.1/os-volumes/0449e758-eff8-4fb1-985a-a83bcb4fbd2a => generated 109 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:28:33.593758 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-03c169f6-0310-43ef-ac50-1c18688bb746 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] Calling method '.version_select at 0x7f4905744b80>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:34.414438 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-03c169f6-0310-43ef-ac50-1c18688bb746 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] HTTP exception thrown: Volume 7e11af57-0ab2-4ef0-a315-d9c5f43cecd3 could not be found. Dec 20 03:28:34.415165 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-03c169f6-0310-43ef-ac50-1c18688bb746 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] Returning 404 to user: Volume 7e11af57-0ab2-4ef0-a315-d9c5f43cecd3 could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:28:34.416188 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-03c169f6-0310-43ef-ac50-1c18688bb746 tempest-VolumesNegativeTest-286064066 tempest-VolumesNegativeTest-286064066-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/7e11af57-0ab2-4ef0-a315-d9c5f43cecd3" status: 404 len: 109 microversion: 2.1 time: 0.829427 Dec 20 03:28:34.421313 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 8/8] 10.222.0.53 () {58 vars in 1244 bytes} [Mon Dec 20 03:28:33 2021] GET /compute/v2.1/os-volumes/7e11af57-0ab2-4ef0-a315-d9c5f43cecd3 => generated 109 bytes in 835 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:28:34.525854 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-8f109804-228b-4368-be90-22710c193464 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.513179 Dec 20 03:28:34.526650 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 1/9] 10.222.0.53 () {60 vars in 1154 bytes} [Mon Dec 20 03:28:32 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 2516 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Dec 20 03:28:34.539843 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f98126dc-f3d4-48e8-9c99-490cbbe8a5f1 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f4905739a60>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:34.698485 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f98126dc-f3d4-48e8-9c99-490cbbe8a5f1 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/e1189feb-0ecc-4313-af03-4f58f76f84a6" status: 200 len: 345 microversion: 2.1 time: 0.163534 Dec 20 03:28:34.701517 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 2/10] 10.222.0.53 () {58 vars in 1244 bytes} [Mon Dec 20 03:28:34 2021] GET /compute/v2.1/os-volumes/e1189feb-0ecc-4313-af03-4f58f76f84a6 => generated 345 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:34.701628 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-6f780781-9610-4ad9-8983-0b4a9233ae5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1457034358", "imageRef": "9c4ec443-915b-4997-82d3-08cc97ba635b", "flavorRef": "452", "networks": [{"uuid": "81fcedcc-7077-48be-86e2-d027fe8cf5ab"}]}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:28:34.880125 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.network.neutron [None req-6f780781-9610-4ad9-8983-0b4a9233ae5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] validate_networks() for [('81fcedcc-7077-48be-86e2-d027fe8cf5ab', None, None, None, None, None)] {{(pid=117011) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:28:34.882060 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-64c2334b-a4ba-4fc8-b795-9d288d3fe797 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-684289547", "imageRef": "9c4ec443-915b-4997-82d3-08cc97ba635b", "flavorRef": "452", "networks": [{"uuid": "7b5bbb6e-f7bb-474e-b520-ee9a420188ee"}]}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:28:34.983151 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.network.neutron [None req-64c2334b-a4ba-4fc8-b795-9d288d3fe797 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] validate_networks() for [('7b5bbb6e-f7bb-474e-b520-ee9a420188ee', None, None, None, None, None)] {{(pid=117012) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:28:35.806127 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-6f780781-9610-4ad9-8983-0b4a9233ae5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Flavor limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:28:35.806734 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-6f780781-9610-4ad9-8983-0b4a9233ae5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Image limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:28:35.807055 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-6f780781-9610-4ad9-8983-0b4a9233ae5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Flavor pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:28:35.807549 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-6f780781-9610-4ad9-8983-0b4a9233ae5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Image pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:28:35.807972 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-6f780781-9610-4ad9-8983-0b4a9233ae5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:28:35.863143 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6f780781-9610-4ad9-8983-0b4a9233ae5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:35.869576 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6f780781-9610-4ad9-8983-0b4a9233ae5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:35.874847 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6f780781-9610-4ad9-8983-0b4a9233ae5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:35.875549 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6f780781-9610-4ad9-8983-0b4a9233ae5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:35.928948 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-6f780781-9610-4ad9-8983-0b4a9233ae5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Getting quotas for project 032e3b59ca34420bbb5bdcaaa1cbb72b. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:28:35.955195 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-6f780781-9610-4ad9-8983-0b4a9233ae5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Getting quotas for user b9dcbac34c544fdea6152f710ab3d521 and project 032e3b59ca34420bbb5bdcaaa1cbb72b. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:28:35.984047 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6f780781-9610-4ad9-8983-0b4a9233ae5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Going to run 1 instances... {{(pid=117011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:28:35.987667 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6f780781-9610-4ad9-8983-0b4a9233ae5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c4ec443-915b-4997-82d3-08cc97ba635b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:28:36.090283 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-64c2334b-a4ba-4fc8-b795-9d288d3fe797 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Flavor limits 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:28:36.092604 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-64c2334b-a4ba-4fc8-b795-9d288d3fe797 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Image limits 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:28:36.093115 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-64c2334b-a4ba-4fc8-b795-9d288d3fe797 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Flavor pref 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:28:36.093567 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-64c2334b-a4ba-4fc8-b795-9d288d3fe797 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Image pref 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:28:36.093990 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-64c2334b-a4ba-4fc8-b795-9d288d3fe797 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:28:36.143362 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-64c2334b-a4ba-4fc8-b795-9d288d3fe797 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:36.144256 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-64c2334b-a4ba-4fc8-b795-9d288d3fe797 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:36.149306 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-6f780781-9610-4ad9-8983-0b4a9233ae5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.726471 Dec 20 03:28:36.155969 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 9/11] 10.222.0.53 () {60 vars in 1146 bytes} [Mon Dec 20 03:28:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 1728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 03:28:36.156070 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-64c2334b-a4ba-4fc8-b795-9d288d3fe797 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:36.156070 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-64c2334b-a4ba-4fc8-b795-9d288d3fe797 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:36.156268 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e26bfee3-7a34-490b-9910-09154f602970 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f4904dd0310>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:36.192962 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-64c2334b-a4ba-4fc8-b795-9d288d3fe797 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Getting quotas for project d299791ac871430b94a15519afc05b7f. Resources: {'instances', 'ram', 'cores'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:28:36.207685 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-64c2334b-a4ba-4fc8-b795-9d288d3fe797 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Getting quotas for user 45f07485037a476bba6071aa489ba402 and project d299791ac871430b94a15519afc05b7f. Resources: {'instances', 'ram', 'cores'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:28:36.211887 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e26bfee3-7a34-490b-9910-09154f602970 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/e1189feb-0ecc-4313-af03-4f58f76f84a6" status: 200 len: 346 microversion: 2.1 time: 0.060107 Dec 20 03:28:36.218488 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 10/12] 10.222.0.53 () {58 vars in 1244 bytes} [Mon Dec 20 03:28:36 2021] GET /compute/v2.1/os-volumes/e1189feb-0ecc-4313-af03-4f58f76f84a6 => generated 346 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:36.218488 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-19791d0d-8269-4572-86d0-0fdb573382e6 tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] Calling method '.version_select at 0x7f4904dd0ee0>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:36.236391 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-64c2334b-a4ba-4fc8-b795-9d288d3fe797 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Going to run 1 instances... {{(pid=117012) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:28:36.237389 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-64c2334b-a4ba-4fc8-b795-9d288d3fe797 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c4ec443-915b-4997-82d3-08cc97ba635b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117012) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:28:36.345222 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-19791d0d-8269-4572-86d0-0fdb573382e6 tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/ba04293e-7b24-45a1-92d9-9e89fcd4d27e" status: 200 len: 351 microversion: 2.1 time: 0.107173 Dec 20 03:28:36.345222 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 11/13] 10.222.0.53 () {58 vars in 1244 bytes} [Mon Dec 20 03:28:36 2021] GET /compute/v2.1/os-volumes/ba04293e-7b24-45a1-92d9-9e89fcd4d27e => generated 351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:36.374306 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-cd6c4972-c457-4165-b6e1-a8f00172310c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:36.374306 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-cd6c4972-c457-4165-b6e1-a8f00172310c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:36.540658 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-cd6c4972-c457-4165-b6e1-a8f00172310c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:36.549037 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-64c2334b-a4ba-4fc8-b795-9d288d3fe797 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.778868 Dec 20 03:28:36.550306 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 3/14] 10.222.0.53 () {60 vars in 1146 bytes} [Mon Dec 20 03:28:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 03:28:36.564210 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1af49c41-c06b-4804-8f21-830eb5a7a31d tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Action: 'create', calling method: .version_select at 0x7f4904dd04c0>, body: {"snapshot": {"volume_id": "e1189feb-0ecc-4313-af03-4f58f76f84a6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1397137545"}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:28:36.579101 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-cd6c4972-c457-4165-b6e1-a8f00172310c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1218 microversion: 2.1 time: 0.233860 Dec 20 03:28:36.580857 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 12/15] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:36 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1218 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:36.590534 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-8666231a-cdf8-4aca-bcc6-87087532ead2 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:36.594640 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-8666231a-cdf8-4aca-bcc6-87087532ead2 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:36.670160 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-8666231a-cdf8-4aca-bcc6-87087532ead2 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:36.678543 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-8666231a-cdf8-4aca-bcc6-87087532ead2 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1214 microversion: 2.1 time: 0.094163 Dec 20 03:28:36.684828 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 13/16] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:36 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:37.604523 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-4c8d154e-05ee-45ec-8a72-275ea30e2a47 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:37.606767 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-4c8d154e-05ee-45ec-8a72-275ea30e2a47 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:37.667880 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-4c8d154e-05ee-45ec-8a72-275ea30e2a47 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:37.678581 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-4c8d154e-05ee-45ec-8a72-275ea30e2a47 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1218 microversion: 2.1 time: 0.075130 Dec 20 03:28:37.679904 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 14/17] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:37 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:37.714048 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-314dfe5f-9426-4947-8d0d-80bca2574304 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:37.714682 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-314dfe5f-9426-4947-8d0d-80bca2574304 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:37.777050 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-314dfe5f-9426-4947-8d0d-80bca2574304 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:37.784898 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-314dfe5f-9426-4947-8d0d-80bca2574304 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1214 microversion: 2.1 time: 0.085208 Dec 20 03:28:37.786956 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 15/18] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:37 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:38.291736 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1af49c41-c06b-4804-8f21-830eb5a7a31d tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.740085 Dec 20 03:28:38.302448 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-8516add6-aa6f-4faf-a9a7-75aefc17c1e3 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f4904593280>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:38.305012 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 4/19] 10.222.0.53 () {60 vars in 1161 bytes} [Mon Dec 20 03:28:36 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:38.357315 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-8516add6-aa6f-4faf-a9a7-75aefc17c1e3 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e" status: 200 len: 287 microversion: 2.1 time: 0.058574 Dec 20 03:28:38.357881 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 16/20] 10.222.0.53 () {58 vars in 1250 bytes} [Mon Dec 20 03:28:38 2021] GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:38.369056 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-6373d2ee-c5fb-4e91-aa37-6cc1a3ec41b3 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f4904dd0d30>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:38.420089 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-6373d2ee-c5fb-4e91-aa37-6cc1a3ec41b3 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.055966 Dec 20 03:28:38.420739 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 5/21] 10.222.0.53 () {58 vars in 1139 bytes} [Mon Dec 20 03:28:38 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:38.430661 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1b5c7252-7196-4084-a612-8e74a2793092 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f4904debee0>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:38.465273 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1b5c7252-7196-4084-a612-8e74a2793092 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e" status: 200 len: 287 microversion: 2.1 time: 0.038130 Dec 20 03:28:38.467566 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 17/22] 10.222.0.53 () {58 vars in 1250 bytes} [Mon Dec 20 03:28:38 2021] GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:38.705227 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-6229ab26-9b18-4f86-9101-a5d6fabf5fd2 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:38.706596 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6229ab26-9b18-4f86-9101-a5d6fabf5fd2 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:38.804653 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-fa30984a-5437-4ce4-b820-0e76159087cd tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:38.808324 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-fa30984a-5437-4ce4-b820-0e76159087cd tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:38.899584 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-6229ab26-9b18-4f86-9101-a5d6fabf5fd2 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:38.946503 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-6229ab26-9b18-4f86-9101-a5d6fabf5fd2 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1218 microversion: 2.1 time: 0.253845 Dec 20 03:28:38.950244 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 6/23] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:38 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1218 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:38.968347 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-fa30984a-5437-4ce4-b820-0e76159087cd tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:38.982754 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-fa30984a-5437-4ce4-b820-0e76159087cd tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1214 microversion: 2.1 time: 0.182491 Dec 20 03:28:38.991721 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 18/24] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:38 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1214 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:39.260331 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-b8042796-d7f7-4042-b4af-2db28bd36133 tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] Calling method '.version_select at 0x7f4904de6dc0>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:39.399830 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-b8042796-d7f7-4042-b4af-2db28bd36133 tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/909e3f93-b353-4f62-b9c9-39012ea76f18" status: 200 len: 351 microversion: 2.1 time: 0.175551 Dec 20 03:28:39.401024 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 7/25] 10.222.0.53 () {58 vars in 1244 bytes} [Mon Dec 20 03:28:39 2021] GET /compute/v2.1/os-volumes/909e3f93-b353-4f62-b9c9-39012ea76f18 => generated 351 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:39.478658 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-93f4959d-bcb3-4248-b8d2-0d34c350152e tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f49045933a0>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:39.966681 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-468238e9-c61a-4360-842a-414413637701 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:39.967651 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-468238e9-c61a-4360-842a-414413637701 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:39.978547 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-468238e9-c61a-4360-842a-414413637701 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:39.979012 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-468238e9-c61a-4360-842a-414413637701 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:39.979826 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-468238e9-c61a-4360-842a-414413637701 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:39.980281 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-468238e9-c61a-4360-842a-414413637701 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:40.143516 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-468238e9-c61a-4360-842a-414413637701 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:40.165806 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-468238e9-c61a-4360-842a-414413637701 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1222 microversion: 2.1 time: 0.202307 Dec 20 03:28:40.166959 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 8/26] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:39 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1222 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:28:40.176180 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-5d377b86-df69-4ddb-a79c-3746bb6484b8 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:40.180521 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-5d377b86-df69-4ddb-a79c-3746bb6484b8 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:40.188410 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5d377b86-df69-4ddb-a79c-3746bb6484b8 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:40.189340 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5d377b86-df69-4ddb-a79c-3746bb6484b8 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:40.191207 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5d377b86-df69-4ddb-a79c-3746bb6484b8 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:40.191830 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5d377b86-df69-4ddb-a79c-3746bb6484b8 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:40.308985 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-5d377b86-df69-4ddb-a79c-3746bb6484b8 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:40.319263 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-5d377b86-df69-4ddb-a79c-3746bb6484b8 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1218 microversion: 2.1 time: 0.149701 Dec 20 03:28:40.329496 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 9/27] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:40 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1218 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:40.722281 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-93f4959d-bcb3-4248-b8d2-0d34c350152e tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e" status: 200 len: 287 microversion: 2.1 time: 1.249010 Dec 20 03:28:40.726001 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 19/28] 10.222.0.53 () {58 vars in 1250 bytes} [Mon Dec 20 03:28:39 2021] GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e => generated 287 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:41.185681 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-b397fb7d-8eeb-4d3c-9a8b-9b567be1af11 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:41.186381 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-b397fb7d-8eeb-4d3c-9a8b-9b567be1af11 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:41.210502 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b397fb7d-8eeb-4d3c-9a8b-9b567be1af11 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:41.211043 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b397fb7d-8eeb-4d3c-9a8b-9b567be1af11 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:41.212747 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b397fb7d-8eeb-4d3c-9a8b-9b567be1af11 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:41.213329 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b397fb7d-8eeb-4d3c-9a8b-9b567be1af11 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:41.306566 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-b397fb7d-8eeb-4d3c-9a8b-9b567be1af11 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:41.319111 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-b397fb7d-8eeb-4d3c-9a8b-9b567be1af11 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1222 microversion: 2.1 time: 0.138061 Dec 20 03:28:41.320286 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 10/29] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:41 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1222 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:41.336387 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-eece25a2-d3fc-455e-a118-9f9086878f12 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:41.337084 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-eece25a2-d3fc-455e-a118-9f9086878f12 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:41.344353 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eece25a2-d3fc-455e-a118-9f9086878f12 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:41.344810 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eece25a2-d3fc-455e-a118-9f9086878f12 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:41.345641 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eece25a2-d3fc-455e-a118-9f9086878f12 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:41.346083 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eece25a2-d3fc-455e-a118-9f9086878f12 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:41.500382 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-eece25a2-d3fc-455e-a118-9f9086878f12 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:41.514980 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-eece25a2-d3fc-455e-a118-9f9086878f12 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1218 microversion: 2.1 time: 0.182973 Dec 20 03:28:41.516251 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 20/30] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:41 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1218 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:41.706074 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-839b1e45-cb50-47bc-b737-100a2ee9c8fe tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'create', calling method: .version_select at 0x7f4904584820>, body: {"keypair": {"name": "tempest-keypair-1488803745"}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:28:41.728105 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-839b1e45-cb50-47bc-b737-100a2ee9c8fe tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Getting quotas for project f6cedc6984fc42c8a1f5b20ec5354095. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:28:41.732242 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-839b1e45-cb50-47bc-b737-100a2ee9c8fe tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Getting quotas for user 84bb957bae32453189561ef619aaf88e and project f6cedc6984fc42c8a1f5b20ec5354095. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:28:41.738311 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d836b6ba-1cdd-452f-adf1-dbb1834eee22 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f490458e5e0>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:41.774062 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d836b6ba-1cdd-452f-adf1-dbb1834eee22 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e" status: 200 len: 287 microversion: 2.1 time: 0.040582 Dec 20 03:28:41.778260 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 21/31] 10.222.0.53 () {58 vars in 1250 bytes} [Mon Dec 20 03:28:41 2021] GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:42.160095 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-839b1e45-cb50-47bc-b737-100a2ee9c8fe tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Getting quotas for project f6cedc6984fc42c8a1f5b20ec5354095. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:28:42.165911 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-839b1e45-cb50-47bc-b737-100a2ee9c8fe tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Getting quotas for user 84bb957bae32453189561ef619aaf88e and project f6cedc6984fc42c8a1f5b20ec5354095. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:28:42.181367 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-839b1e45-cb50-47bc-b737-100a2ee9c8fe tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.594497 Dec 20 03:28:42.187621 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 11/32] 10.222.0.53 () {60 vars in 1157 bytes} [Mon Dec 20 03:28:41 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:42.338133 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-63608f63-549a-4fca-ac39-cc07d0f6c84d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:42.338902 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-63608f63-549a-4fca-ac39-cc07d0f6c84d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:42.346715 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-63608f63-549a-4fca-ac39-cc07d0f6c84d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:42.347240 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-63608f63-549a-4fca-ac39-cc07d0f6c84d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:42.348127 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-63608f63-549a-4fca-ac39-cc07d0f6c84d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:42.348760 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-63608f63-549a-4fca-ac39-cc07d0f6c84d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:42.430501 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-63608f63-549a-4fca-ac39-cc07d0f6c84d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:42.438668 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-63608f63-549a-4fca-ac39-cc07d0f6c84d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1222 microversion: 2.1 time: 0.105217 Dec 20 03:28:42.439380 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 22/33] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:42 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1222 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:28:42.531938 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-bf923308-10a6-4d6e-9acc-5f17a03bb527 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:42.532765 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-bf923308-10a6-4d6e-9acc-5f17a03bb527 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:42.540999 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bf923308-10a6-4d6e-9acc-5f17a03bb527 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:42.541487 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bf923308-10a6-4d6e-9acc-5f17a03bb527 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:42.542280 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bf923308-10a6-4d6e-9acc-5f17a03bb527 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:42.542874 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bf923308-10a6-4d6e-9acc-5f17a03bb527 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:42.613153 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-bf923308-10a6-4d6e-9acc-5f17a03bb527 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:42.621772 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-bf923308-10a6-4d6e-9acc-5f17a03bb527 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1210 microversion: 2.1 time: 0.093810 Dec 20 03:28:42.622431 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 12/34] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:42 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:42.788453 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-4bcb6b74-f2f3-4542-bc49-aeb0cb6f6b91 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f4904593af0>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:42.823526 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-4bcb6b74-f2f3-4542-bc49-aeb0cb6f6b91 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e" status: 200 len: 288 microversion: 2.1 time: 0.040129 Dec 20 03:28:42.824092 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 23/35] 10.222.0.53 () {58 vars in 1250 bytes} [Mon Dec 20 03:28:42 2021] GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e => generated 288 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:42.834929 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d36ded10-a38a-4b7b-a4ca-f832a11bd0eb tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f490457b670>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:42.983248 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d36ded10-a38a-4b7b-a4ca-f832a11bd0eb tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "DELETE /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e" status: 202 len: 0 microversion: 2.1 time: 0.152573 Dec 20 03:28:42.983849 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 13/36] 10.222.0.53 () {58 vars in 1253 bytes} [Mon Dec 20 03:28:42 2021] DELETE /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:28:42.993202 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-521c2f43-b40f-4086-8791-5c00afbf5c5a tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f4904523310>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:43.050325 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-521c2f43-b40f-4086-8791-5c00afbf5c5a tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e" status: 200 len: 287 microversion: 2.1 time: 0.061666 Dec 20 03:28:43.050895 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 24/37] 10.222.0.53 () {58 vars in 1250 bytes} [Mon Dec 20 03:28:42 2021] GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:43.456981 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-49ab8449-0fee-4d71-9d6f-c7d92d69b434 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:43.457626 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-49ab8449-0fee-4d71-9d6f-c7d92d69b434 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:43.464575 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-49ab8449-0fee-4d71-9d6f-c7d92d69b434 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:43.465076 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-49ab8449-0fee-4d71-9d6f-c7d92d69b434 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:43.465882 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-49ab8449-0fee-4d71-9d6f-c7d92d69b434 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:43.466319 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-49ab8449-0fee-4d71-9d6f-c7d92d69b434 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:43.547466 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-49ab8449-0fee-4d71-9d6f-c7d92d69b434 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:43.555182 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-49ab8449-0fee-4d71-9d6f-c7d92d69b434 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1270 microversion: 2.1 time: 0.101735 Dec 20 03:28:43.560137 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 14/38] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:43 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1270 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:43.641463 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-6a13c903-bf36-4e1f-927f-1ad2375888a6 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:43.643452 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6a13c903-bf36-4e1f-927f-1ad2375888a6 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:43.655786 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6a13c903-bf36-4e1f-927f-1ad2375888a6 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:43.658230 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6a13c903-bf36-4e1f-927f-1ad2375888a6 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:43.658230 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6a13c903-bf36-4e1f-927f-1ad2375888a6 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:43.658543 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6a13c903-bf36-4e1f-927f-1ad2375888a6 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:43.750397 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6a13c903-bf36-4e1f-927f-1ad2375888a6 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:43.759652 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-6a13c903-bf36-4e1f-927f-1ad2375888a6 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1210 microversion: 2.1 time: 0.124130 Dec 20 03:28:43.760266 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 25/39] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:43 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1210 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:44.062431 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e1b2352a-e853-4e20-825d-52e1de36dbe8 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f49044fce50>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:44.112189 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e1b2352a-e853-4e20-825d-52e1de36dbe8 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e" status: 200 len: 287 microversion: 2.1 time: 0.049664 Dec 20 03:28:44.118220 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 15/40] 10.222.0.53 () {58 vars in 1250 bytes} [Mon Dec 20 03:28:44 2021] GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:44.576461 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-c722042f-b43f-4195-bc1a-3855f86c39f1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:44.577202 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-c722042f-b43f-4195-bc1a-3855f86c39f1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:44.584755 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c722042f-b43f-4195-bc1a-3855f86c39f1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:44.585241 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c722042f-b43f-4195-bc1a-3855f86c39f1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:44.586131 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c722042f-b43f-4195-bc1a-3855f86c39f1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:44.586567 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c722042f-b43f-4195-bc1a-3855f86c39f1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:44.666125 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-c722042f-b43f-4195-bc1a-3855f86c39f1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:44.674073 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-c722042f-b43f-4195-bc1a-3855f86c39f1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1270 microversion: 2.1 time: 0.101289 Dec 20 03:28:44.674643 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 26/41] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:44 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:44.776908 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-77e87a3a-428f-4771-8f56-5367485ef8dd tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:44.778514 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-77e87a3a-428f-4771-8f56-5367485ef8dd tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:44.789173 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-77e87a3a-428f-4771-8f56-5367485ef8dd tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:44.789650 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-77e87a3a-428f-4771-8f56-5367485ef8dd tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:44.790711 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-77e87a3a-428f-4771-8f56-5367485ef8dd tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:44.791403 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-77e87a3a-428f-4771-8f56-5367485ef8dd tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:44.865534 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-77e87a3a-428f-4771-8f56-5367485ef8dd tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:44.874159 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-77e87a3a-428f-4771-8f56-5367485ef8dd tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1210 microversion: 2.1 time: 0.101036 Dec 20 03:28:44.875410 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 16/42] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:44 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:45.075039 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-3de2c623-efa6-46a4-8565-8b17ca2073dd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1931944939", "imageRef": "9c4ec443-915b-4997-82d3-08cc97ba635b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6092e9e-6552-44a6-a685-c033f6e4e6c9"}], "security_groups": [{"name": "tempest-securitygroup--832511605"}], "key_name": "tempest-keypair-1488803745", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:28:45.125004 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c997367a-e3be-47a1-8a7b-852c5b91cc3d tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f49045843a0>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:45.164273 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c997367a-e3be-47a1-8a7b-852c5b91cc3d tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e" status: 200 len: 287 microversion: 2.1 time: 0.042937 Dec 20 03:28:45.164854 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 17/43] 10.222.0.53 () {58 vars in 1250 bytes} [Mon Dec 20 03:28:45 2021] GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:45.231044 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.network.neutron [None req-3de2c623-efa6-46a4-8565-8b17ca2073dd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] validate_networks() for [('c6092e9e-6552-44a6-a685-c033f6e4e6c9', None, None, None, None, None)] {{(pid=117011) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:28:45.650216 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-3de2c623-efa6-46a4-8565-8b17ca2073dd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Flavor limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:28:45.650758 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-3de2c623-efa6-46a4-8565-8b17ca2073dd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Image limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:28:45.651109 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-3de2c623-efa6-46a4-8565-8b17ca2073dd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Flavor pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:28:45.651521 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-3de2c623-efa6-46a4-8565-8b17ca2073dd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Image pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:28:45.651931 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-3de2c623-efa6-46a4-8565-8b17ca2073dd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:28:45.661438 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3de2c623-efa6-46a4-8565-8b17ca2073dd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:45.662284 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3de2c623-efa6-46a4-8565-8b17ca2073dd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:45.663108 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3de2c623-efa6-46a4-8565-8b17ca2073dd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:45.663637 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3de2c623-efa6-46a4-8565-8b17ca2073dd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:45.681661 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-3de2c623-efa6-46a4-8565-8b17ca2073dd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Getting quotas for project f6cedc6984fc42c8a1f5b20ec5354095. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:28:45.685781 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-3de2c623-efa6-46a4-8565-8b17ca2073dd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Getting quotas for user 84bb957bae32453189561ef619aaf88e and project f6cedc6984fc42c8a1f5b20ec5354095. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:28:45.691126 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-78e24dfb-5566-4ae0-b72a-57a6341e2321 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:45.692113 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-78e24dfb-5566-4ae0-b72a-57a6341e2321 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:45.698966 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-3de2c623-efa6-46a4-8565-8b17ca2073dd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Going to run 1 instances... {{(pid=117011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:28:45.699371 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-78e24dfb-5566-4ae0-b72a-57a6341e2321 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:45.700147 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-78e24dfb-5566-4ae0-b72a-57a6341e2321 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:45.700775 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-78e24dfb-5566-4ae0-b72a-57a6341e2321 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:45.701213 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-3de2c623-efa6-46a4-8565-8b17ca2073dd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c4ec443-915b-4997-82d3-08cc97ba635b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:28:45.701349 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-78e24dfb-5566-4ae0-b72a-57a6341e2321 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:45.763186 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-78e24dfb-5566-4ae0-b72a-57a6341e2321 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:45.770412 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-78e24dfb-5566-4ae0-b72a-57a6341e2321 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1270 microversion: 2.1 time: 0.082814 Dec 20 03:28:45.771117 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 18/44] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:45 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:28:45.844412 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-3de2c623-efa6-46a4-8565-8b17ca2073dd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.774924 Dec 20 03:28:45.845193 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 27/45] 10.222.0.53 () {60 vars in 1146 bytes} [Mon Dec 20 03:28:45 2021] POST /compute/v2.1/servers => generated 401 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 03:28:45.855112 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-8a15b4cf-aa4e-4b7d-ab80-25647c0dea45 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:45.856644 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-8a15b4cf-aa4e-4b7d-ab80-25647c0dea45 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:45.897098 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a3fd447d-db0b-4ec6-a277-2932e81d4283 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:45.897098 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a3fd447d-db0b-4ec6-a277-2932e81d4283 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:45.899888 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a3fd447d-db0b-4ec6-a277-2932e81d4283 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:45.900283 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a3fd447d-db0b-4ec6-a277-2932e81d4283 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:45.901106 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a3fd447d-db0b-4ec6-a277-2932e81d4283 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:45.901574 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a3fd447d-db0b-4ec6-a277-2932e81d4283 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:45.984597 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-a3fd447d-db0b-4ec6-a277-2932e81d4283 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:45.984942 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-8a15b4cf-aa4e-4b7d-ab80-25647c0dea45 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:45.987234 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a3fd447d-db0b-4ec6-a277-2932e81d4283 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1266 microversion: 2.1 time: 0.099362 Dec 20 03:28:45.987802 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 28/46] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:45 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:45.988921 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-8a15b4cf-aa4e-4b7d-ab80-25647c0dea45 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1238 microversion: 2.1 time: 0.137162 Dec 20 03:28:46.000861 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 19/47] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:45 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1238 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:46.176143 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b250c968-39cb-4792-8099-981a982e3be0 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f490458e3a0>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:46.208053 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b250c968-39cb-4792-8099-981a982e3be0 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e" status: 200 len: 287 microversion: 2.1 time: 0.035963 Dec 20 03:28:46.208623 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 29/48] 10.222.0.53 () {58 vars in 1250 bytes} [Mon Dec 20 03:28:46 2021] GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:46.786808 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-b6223838-0bcb-4238-884d-0a502e8f7bf1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:46.788821 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-b6223838-0bcb-4238-884d-0a502e8f7bf1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:46.796013 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b6223838-0bcb-4238-884d-0a502e8f7bf1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:46.796764 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b6223838-0bcb-4238-884d-0a502e8f7bf1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:46.798227 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b6223838-0bcb-4238-884d-0a502e8f7bf1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:46.799016 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b6223838-0bcb-4238-884d-0a502e8f7bf1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:46.889954 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-b6223838-0bcb-4238-884d-0a502e8f7bf1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:46.898854 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-b6223838-0bcb-4238-884d-0a502e8f7bf1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1278 microversion: 2.1 time: 0.115786 Dec 20 03:28:46.899435 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 20/49] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:46 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1278 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:47.008307 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-45108df0-8325-4952-9640-92997a138eca tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:47.009119 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-45108df0-8325-4952-9640-92997a138eca tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:47.010110 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-3fb5ed0d-a418-4a91-9dc6-acccfa407db9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:47.011074 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-3fb5ed0d-a418-4a91-9dc6-acccfa407db9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:47.016349 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-45108df0-8325-4952-9640-92997a138eca tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:47.016896 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-45108df0-8325-4952-9640-92997a138eca tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:47.018020 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-45108df0-8325-4952-9640-92997a138eca tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:47.018589 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-45108df0-8325-4952-9640-92997a138eca tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:47.019011 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3fb5ed0d-a418-4a91-9dc6-acccfa407db9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:47.019534 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3fb5ed0d-a418-4a91-9dc6-acccfa407db9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:47.020398 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3fb5ed0d-a418-4a91-9dc6-acccfa407db9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:47.020985 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3fb5ed0d-a418-4a91-9dc6-acccfa407db9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:47.101087 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-45108df0-8325-4952-9640-92997a138eca tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:47.113859 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-45108df0-8325-4952-9640-92997a138eca tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1266 microversion: 2.1 time: 0.111274 Dec 20 03:28:47.114831 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 30/50] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:47 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:47.207010 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-3fb5ed0d-a418-4a91-9dc6-acccfa407db9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:47.216072 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-3fb5ed0d-a418-4a91-9dc6-acccfa407db9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1242 microversion: 2.1 time: 0.210986 Dec 20 03:28:47.217009 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 21/51] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:47 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1242 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:28:47.225658 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-dc554ce7-cc7f-473c-a1e6-36c12277ebc3 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f49045231f0>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:47.262606 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-dc554ce7-cc7f-473c-a1e6-36c12277ebc3 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e" status: 200 len: 287 microversion: 2.1 time: 0.045042 Dec 20 03:28:47.263310 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 31/52] 10.222.0.53 () {58 vars in 1250 bytes} [Mon Dec 20 03:28:47 2021] GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:28:47.916953 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a7f13ecf-6051-4071-80a6-746f7d4ef56a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:47.917606 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a7f13ecf-6051-4071-80a6-746f7d4ef56a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:47.924142 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a7f13ecf-6051-4071-80a6-746f7d4ef56a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:47.924595 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a7f13ecf-6051-4071-80a6-746f7d4ef56a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:47.925425 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a7f13ecf-6051-4071-80a6-746f7d4ef56a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:47.925870 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a7f13ecf-6051-4071-80a6-746f7d4ef56a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:47.991117 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-a7f13ecf-6051-4071-80a6-746f7d4ef56a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:47.999014 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a7f13ecf-6051-4071-80a6-746f7d4ef56a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1278 microversion: 2.1 time: 0.086370 Dec 20 03:28:47.999606 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 22/53] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:47 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1278 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:28:48.133316 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a18a5390-6349-40ea-9dfe-089ccbdafeca tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:48.133963 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a18a5390-6349-40ea-9dfe-089ccbdafeca tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:48.140246 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a18a5390-6349-40ea-9dfe-089ccbdafeca tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:48.140757 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a18a5390-6349-40ea-9dfe-089ccbdafeca tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:48.141707 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a18a5390-6349-40ea-9dfe-089ccbdafeca tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:48.142206 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a18a5390-6349-40ea-9dfe-089ccbdafeca tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:48.208584 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-a18a5390-6349-40ea-9dfe-089ccbdafeca tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:48.217736 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a18a5390-6349-40ea-9dfe-089ccbdafeca tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1266 microversion: 2.1 time: 0.088279 Dec 20 03:28:48.218348 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 32/54] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:48 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:48.246096 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-db64d598-70aa-4754-b38a-6e32b11978dc tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:48.247186 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-db64d598-70aa-4754-b38a-6e32b11978dc tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:48.256986 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-db64d598-70aa-4754-b38a-6e32b11978dc tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:48.257802 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-db64d598-70aa-4754-b38a-6e32b11978dc tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:48.259229 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-db64d598-70aa-4754-b38a-6e32b11978dc tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:48.259983 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-db64d598-70aa-4754-b38a-6e32b11978dc tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:48.276153 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-5d63f5ac-5095-4bfa-8624-6d1db491d780 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f49056dad30>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:48.310263 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-5d63f5ac-5095-4bfa-8624-6d1db491d780 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e" status: 200 len: 287 microversion: 2.1 time: 0.038527 Dec 20 03:28:48.311473 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 33/55] 10.222.0.53 () {58 vars in 1250 bytes} [Mon Dec 20 03:28:48 2021] GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:28:48.343752 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-db64d598-70aa-4754-b38a-6e32b11978dc tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:48.352445 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-db64d598-70aa-4754-b38a-6e32b11978dc tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1242 microversion: 2.1 time: 0.112917 Dec 20 03:28:48.353206 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 23/56] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:48 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1242 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:49.024389 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-4782a125-a230-4f5e-badc-4a60a3e4ae13 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:49.025511 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-4782a125-a230-4f5e-badc-4a60a3e4ae13 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:49.033497 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4782a125-a230-4f5e-badc-4a60a3e4ae13 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:49.033953 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4782a125-a230-4f5e-badc-4a60a3e4ae13 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:49.035110 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4782a125-a230-4f5e-badc-4a60a3e4ae13 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:49.035878 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4782a125-a230-4f5e-badc-4a60a3e4ae13 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:49.116974 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-4782a125-a230-4f5e-badc-4a60a3e4ae13 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:49.129815 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-4782a125-a230-4f5e-badc-4a60a3e4ae13 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1276 microversion: 2.1 time: 0.113293 Dec 20 03:28:49.131328 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 34/57] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:49 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1276 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:28:49.236666 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-fc194417-3b2b-4ba0-b090-7ff255c7499f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:49.237859 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-fc194417-3b2b-4ba0-b090-7ff255c7499f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:49.247618 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fc194417-3b2b-4ba0-b090-7ff255c7499f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:49.248332 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fc194417-3b2b-4ba0-b090-7ff255c7499f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:49.251591 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fc194417-3b2b-4ba0-b090-7ff255c7499f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:49.251591 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fc194417-3b2b-4ba0-b090-7ff255c7499f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:49.329414 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-fe5c8e00-7369-4c88-8e15-96fb3ea0f8d3 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f49056daca0>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:49.406167 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-fe5c8e00-7369-4c88-8e15-96fb3ea0f8d3 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e" status: 200 len: 287 microversion: 2.1 time: 0.085075 Dec 20 03:28:49.418625 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 35/58] 10.222.0.53 () {58 vars in 1250 bytes} [Mon Dec 20 03:28:49 2021] GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:28:49.428496 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-8c75b022-7b6b-497e-ac82-1922c0971c31 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:49.430831 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-8c75b022-7b6b-497e-ac82-1922c0971c31 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:49.449179 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8c75b022-7b6b-497e-ac82-1922c0971c31 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:49.450342 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8c75b022-7b6b-497e-ac82-1922c0971c31 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:49.452204 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8c75b022-7b6b-497e-ac82-1922c0971c31 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:49.453380 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8c75b022-7b6b-497e-ac82-1922c0971c31 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:49.763264 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-8c75b022-7b6b-497e-ac82-1922c0971c31 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:49.775612 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-8c75b022-7b6b-497e-ac82-1922c0971c31 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1234 microversion: 2.1 time: 0.354796 Dec 20 03:28:49.776859 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 36/59] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:49 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1234 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:49.847524 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-9f9fb8d3-49d1-4a18-9cce-a06c3845e72d tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] Calling method '.version_select at 0x7f490450c040>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:49.872382 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-fc194417-3b2b-4ba0-b090-7ff255c7499f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:49.888931 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-fc194417-3b2b-4ba0-b090-7ff255c7499f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1266 microversion: 2.1 time: 0.656806 Dec 20 03:28:49.900143 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 24/60] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:49 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1266 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:28:49.960076 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-9f9fb8d3-49d1-4a18-9cce-a06c3845e72d tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/7e059bf6-2d8f-4c68-bc47-d2e0c0e7bd44" status: 200 len: 351 microversion: 2.1 time: 0.115088 Dec 20 03:28:49.961770 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 37/61] 10.222.0.53 () {58 vars in 1244 bytes} [Mon Dec 20 03:28:49 2021] GET /compute/v2.1/os-volumes/7e059bf6-2d8f-4c68-bc47-d2e0c0e7bd44 => generated 351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:28:49.974257 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-885c56b0-3f12-4e46-81a8-f0af3470661e tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] Calling method '.version_select at 0x7f49044fc4c0>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:50.079307 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-885c56b0-3f12-4e46-81a8-f0af3470661e tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] 10.222.0.53 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.108679 Dec 20 03:28:50.081045 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 25/62] 10.222.0.53 () {58 vars in 1133 bytes} [Mon Dec 20 03:28:49 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:50.098921 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-5ed546fb-c75a-4b38-9be1-16e228a92846 tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] Calling method '.version_select at 0x7f4904500820>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:50.153959 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-cdc1df8e-c927-4d3f-9f5e-2ef22193fda1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:50.155378 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-cdc1df8e-c927-4d3f-9f5e-2ef22193fda1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:50.167279 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cdc1df8e-c927-4d3f-9f5e-2ef22193fda1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:50.168430 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cdc1df8e-c927-4d3f-9f5e-2ef22193fda1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:50.170918 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cdc1df8e-c927-4d3f-9f5e-2ef22193fda1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:50.172386 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cdc1df8e-c927-4d3f-9f5e-2ef22193fda1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:50.267726 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-5ed546fb-c75a-4b38-9be1-16e228a92846 tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] 10.222.0.53 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.176305 Dec 20 03:28:50.268505 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 38/63] 10.222.0.53 () {58 vars in 1148 bytes} [Mon Dec 20 03:28:50 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:50.281914 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f3db1a42-ad01-4f77-967e-1c676c1d89ba tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] Calling method '.version_select at 0x7f4904540700>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:50.372514 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f3db1a42-ad01-4f77-967e-1c676c1d89ba tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] 10.222.0.53 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.094101 Dec 20 03:28:50.373857 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 39/64] 10.222.0.53 () {58 vars in 1133 bytes} [Mon Dec 20 03:28:50 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:50.387816 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-8a8fd713-da5d-4c9a-a056-b6acda7fe590 tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] Calling method '.version_select at 0x7f49044e1ca0>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:50.534087 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-8a8fd713-da5d-4c9a-a056-b6acda7fe590 tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] 10.222.0.53 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.152250 Dec 20 03:28:50.535320 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 40/65] 10.222.0.53 () {58 vars in 1166 bytes} [Mon Dec 20 03:28:50 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:50.540393 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-990e0928-7eab-46d7-a007-a94c7c5371c5 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f490458e3a0>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:50.557190 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-cdc1df8e-c927-4d3f-9f5e-2ef22193fda1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:50.569516 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-cdc1df8e-c927-4d3f-9f5e-2ef22193fda1 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.422771 Dec 20 03:28:50.571711 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 26/66] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:50 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:50.577055 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-4daef591-b859-47b7-a0dc-203f4637bb81 tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] Calling method '.version_select at 0x7f49044fc160>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:50.625835 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-990e0928-7eab-46d7-a007-a94c7c5371c5 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] HTTP exception thrown: Snapshot c600ccc7-846d-44a5-a20d-a16d054ece8e could not be found. Dec 20 03:28:50.625835 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-990e0928-7eab-46d7-a007-a94c7c5371c5 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Returning 404 to user: Snapshot c600ccc7-846d-44a5-a20d-a16d054ece8e could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:28:50.625835 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-990e0928-7eab-46d7-a007-a94c7c5371c5 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e" status: 404 len: 111 microversion: 2.1 time: 0.074195 Dec 20 03:28:50.625835 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 41/67] 10.222.0.53 () {58 vars in 1250 bytes} [Mon Dec 20 03:28:50 2021] GET /compute/v2.1/os-snapshots/c600ccc7-846d-44a5-a20d-a16d054ece8e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:28:50.625835 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-7eeac234-0959-44fb-8acc-ebfac52b6b02 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f4904dd01f0>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:50.694425 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-4daef591-b859-47b7-a0dc-203f4637bb81 tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.120252 Dec 20 03:28:50.695548 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 27/68] 10.222.0.53 () {58 vars in 1169 bytes} [Mon Dec 20 03:28:50 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:50.712524 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1a92375f-9f39-48bc-ac6f-50c2e96be124 tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] Calling method '.version_select at 0x7f4904490c10>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:51.010044 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-7eeac234-0959-44fb-8acc-ebfac52b6b02 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "DELETE /compute/v2.1/os-volumes/e1189feb-0ecc-4313-af03-4f58f76f84a6" status: 202 len: 0 microversion: 2.1 time: 0.391987 Dec 20 03:28:51.014851 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 42/69] 10.222.0.53 () {58 vars in 1247 bytes} [Mon Dec 20 03:28:50 2021] DELETE /compute/v2.1/os-volumes/e1189feb-0ecc-4313-af03-4f58f76f84a6 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 20 03:28:51.016783 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-736d3f1c-2e5d-4353-80cb-b73d7af60959 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:51.017451 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-736d3f1c-2e5d-4353-80cb-b73d7af60959 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:51.023934 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-736d3f1c-2e5d-4353-80cb-b73d7af60959 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:51.024311 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-736d3f1c-2e5d-4353-80cb-b73d7af60959 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:51.025112 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-736d3f1c-2e5d-4353-80cb-b73d7af60959 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:51.025588 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-736d3f1c-2e5d-4353-80cb-b73d7af60959 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:51.083422 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1a92375f-9f39-48bc-ac6f-50c2e96be124 tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.377819 Dec 20 03:28:51.084446 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 28/70] 10.222.0.53 () {58 vars in 1154 bytes} [Mon Dec 20 03:28:50 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:51.104914 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-03e3dab0-3b3b-46b5-87a6-41c45d28133a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:51.104914 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-03e3dab0-3b3b-46b5-87a6-41c45d28133a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:51.104914 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-03e3dab0-3b3b-46b5-87a6-41c45d28133a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:51.104914 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-03e3dab0-3b3b-46b5-87a6-41c45d28133a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:51.106037 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-03e3dab0-3b3b-46b5-87a6-41c45d28133a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:51.106261 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-736d3f1c-2e5d-4353-80cb-b73d7af60959 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:51.106451 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-03e3dab0-3b3b-46b5-87a6-41c45d28133a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:51.112243 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-736d3f1c-2e5d-4353-80cb-b73d7af60959 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1290 microversion: 2.1 time: 0.099951 Dec 20 03:28:51.118954 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 43/71] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:51 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1290 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:51.124073 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-4e5b9de9-db30-4912-9806-e621f52036cf tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f49045404c0>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:51.190910 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-03e3dab0-3b3b-46b5-87a6-41c45d28133a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:51.190910 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-03e3dab0-3b3b-46b5-87a6-41c45d28133a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1284 microversion: 2.1 time: 0.103098 Dec 20 03:28:51.190910 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 29/72] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:51 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:51.196229 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-8c042df5-de49-473a-8184-6abe4d02de5d tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] Calling method '.version_select at 0x7f490457bb80>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:51.203949 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-4e5b9de9-db30-4912-9806-e621f52036cf tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/e1189feb-0ecc-4313-af03-4f58f76f84a6" status: 200 len: 345 microversion: 2.1 time: 0.083396 Dec 20 03:28:51.204701 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 44/73] 10.222.0.53 () {58 vars in 1244 bytes} [Mon Dec 20 03:28:51 2021] GET /compute/v2.1/os-volumes/e1189feb-0ecc-4313-af03-4f58f76f84a6 => generated 345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:51.282981 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-8c042df5-de49-473a-8184-6abe4d02de5d tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091347 Dec 20 03:28:51.283560 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 30/74] 10.222.0.53 () {58 vars in 1187 bytes} [Mon Dec 20 03:28:51 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:51.297178 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-4e5f4394-8aad-484f-ab9c-d4bc13fb1fa2 tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] Calling method '.version_select at 0x7f490458e280>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:51.378376 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-4e5f4394-8aad-484f-ab9c-d4bc13fb1fa2 tempest-VolumesTestJSON-1569570857 tempest-VolumesTestJSON-1569570857-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.084725 Dec 20 03:28:51.379796 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 45/75] 10.222.0.53 () {58 vars in 1154 bytes} [Mon Dec 20 03:28:51 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:51.595981 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-b43fb8f0-54a0-4336-b771-b971e02d9454 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:51.596723 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-b43fb8f0-54a0-4336-b771-b971e02d9454 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:51.604335 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b43fb8f0-54a0-4336-b771-b971e02d9454 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:51.604791 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b43fb8f0-54a0-4336-b771-b971e02d9454 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:51.605862 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b43fb8f0-54a0-4336-b771-b971e02d9454 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:51.606569 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b43fb8f0-54a0-4336-b771-b971e02d9454 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:51.746830 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-b43fb8f0-54a0-4336-b771-b971e02d9454 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:51.755660 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-b43fb8f0-54a0-4336-b771-b971e02d9454 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.163284 Dec 20 03:28:51.757115 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 31/76] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:51 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:52.135687 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0ecac651-430c-42e1-a09c-9c2afb177abd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:52.136309 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-0ecac651-430c-42e1-a09c-9c2afb177abd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:52.142942 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0ecac651-430c-42e1-a09c-9c2afb177abd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:52.143396 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0ecac651-430c-42e1-a09c-9c2afb177abd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:52.144174 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0ecac651-430c-42e1-a09c-9c2afb177abd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:52.144614 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0ecac651-430c-42e1-a09c-9c2afb177abd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:52.209559 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-0ecac651-430c-42e1-a09c-9c2afb177abd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:52.217372 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-0ecac651-430c-42e1-a09c-9c2afb177abd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1290 microversion: 2.1 time: 0.085413 Dec 20 03:28:52.217522 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-47145765-a053-413f-b236-6d0333d528df tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:52.227264 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 46/77] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:52 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:52.227633 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-47145765-a053-413f-b236-6d0333d528df tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:52.227703 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b1c7b4b0-9dac-44a9-b978-c7a05894d5b4 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f4904540c10>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:52.230068 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-47145765-a053-413f-b236-6d0333d528df tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:52.231021 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-47145765-a053-413f-b236-6d0333d528df tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:52.231954 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-47145765-a053-413f-b236-6d0333d528df tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:52.232794 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-47145765-a053-413f-b236-6d0333d528df tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:52.275266 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b1c7b4b0-9dac-44a9-b978-c7a05894d5b4 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/e1189feb-0ecc-4313-af03-4f58f76f84a6" status: 200 len: 345 microversion: 2.1 time: 0.056244 Dec 20 03:28:52.275842 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 47/78] 10.222.0.53 () {58 vars in 1244 bytes} [Mon Dec 20 03:28:52 2021] GET /compute/v2.1/os-volumes/e1189feb-0ecc-4313-af03-4f58f76f84a6 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:52.306712 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-47145765-a053-413f-b236-6d0333d528df tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:52.314289 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-47145765-a053-413f-b236-6d0333d528df tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1284 microversion: 2.1 time: 0.107294 Dec 20 03:28:52.314894 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 32/79] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:52 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:52.782049 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-de41d42d-f517-4319-8a45-aaf751eae632 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:52.782049 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-de41d42d-f517-4319-8a45-aaf751eae632 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:52.789297 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-de41d42d-f517-4319-8a45-aaf751eae632 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:52.789987 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-de41d42d-f517-4319-8a45-aaf751eae632 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:52.801452 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-de41d42d-f517-4319-8a45-aaf751eae632 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:52.802164 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-de41d42d-f517-4319-8a45-aaf751eae632 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:52.979809 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-de41d42d-f517-4319-8a45-aaf751eae632 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:52.990580 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-de41d42d-f517-4319-8a45-aaf751eae632 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.217495 Dec 20 03:28:52.991771 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 48/80] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:52 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:28:53.236027 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f7494f32-7369-4c35-b6e9-77d2a4b169b8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:53.236680 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f7494f32-7369-4c35-b6e9-77d2a4b169b8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:53.247327 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f7494f32-7369-4c35-b6e9-77d2a4b169b8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:53.247821 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f7494f32-7369-4c35-b6e9-77d2a4b169b8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:53.248712 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f7494f32-7369-4c35-b6e9-77d2a4b169b8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:53.249497 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f7494f32-7369-4c35-b6e9-77d2a4b169b8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:53.339853 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-3cdc37f2-5160-4c7f-b1d4-98518a6bd4f4 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f490450ce50>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:53.340270 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-f7494f32-7369-4c35-b6e9-77d2a4b169b8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:53.341494 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f7494f32-7369-4c35-b6e9-77d2a4b169b8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1290 microversion: 2.1 time: 0.108183 Dec 20 03:28:53.342333 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 33/81] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:53 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1290 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:53.348826 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-022b3c45-7190-4197-abea-c71a1d36952a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:53.350252 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-022b3c45-7190-4197-abea-c71a1d36952a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:53.357832 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-022b3c45-7190-4197-abea-c71a1d36952a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:53.358798 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-022b3c45-7190-4197-abea-c71a1d36952a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:53.359853 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-022b3c45-7190-4197-abea-c71a1d36952a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:53.360552 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-022b3c45-7190-4197-abea-c71a1d36952a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:53.432180 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-3cdc37f2-5160-4c7f-b1d4-98518a6bd4f4 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/e1189feb-0ecc-4313-af03-4f58f76f84a6" status: 200 len: 345 microversion: 2.1 time: 0.143554 Dec 20 03:28:53.433799 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 49/82] 10.222.0.53 () {58 vars in 1244 bytes} [Mon Dec 20 03:28:53 2021] GET /compute/v2.1/os-volumes/e1189feb-0ecc-4313-af03-4f58f76f84a6 => generated 345 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:28:53.463425 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-022b3c45-7190-4197-abea-c71a1d36952a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:53.473118 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-022b3c45-7190-4197-abea-c71a1d36952a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1284 microversion: 2.1 time: 0.129238 Dec 20 03:28:53.473751 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 34/83] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:53 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:54.010752 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-6fe6bea6-f40f-47be-8d0c-f51cbff62786 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:54.012142 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6fe6bea6-f40f-47be-8d0c-f51cbff62786 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:54.018519 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6fe6bea6-f40f-47be-8d0c-f51cbff62786 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:54.019065 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6fe6bea6-f40f-47be-8d0c-f51cbff62786 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:54.020051 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6fe6bea6-f40f-47be-8d0c-f51cbff62786 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:54.020637 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6fe6bea6-f40f-47be-8d0c-f51cbff62786 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:54.250584 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6fe6bea6-f40f-47be-8d0c-f51cbff62786 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:54.261897 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-6fe6bea6-f40f-47be-8d0c-f51cbff62786 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.255457 Dec 20 03:28:54.262646 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 50/84] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:54 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:54.369214 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1c5073b8-f4f5-448b-a02a-4739f17bf716 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:54.372888 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1c5073b8-f4f5-448b-a02a-4739f17bf716 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:54.377039 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1c5073b8-f4f5-448b-a02a-4739f17bf716 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:54.377778 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1c5073b8-f4f5-448b-a02a-4739f17bf716 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:54.378807 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1c5073b8-f4f5-448b-a02a-4739f17bf716 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:54.382258 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1c5073b8-f4f5-448b-a02a-4739f17bf716 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:54.493053 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ac20e620-ceb8-4afe-9bbe-f658c7c6301c tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f490450c040>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:54.503688 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1c5073b8-f4f5-448b-a02a-4739f17bf716 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:54.513745 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-ac20e620-ceb8-4afe-9bbe-f658c7c6301c tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] HTTP exception thrown: Volume e1189feb-0ecc-4313-af03-4f58f76f84a6 could not be found. Dec 20 03:28:54.515186 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ac20e620-ceb8-4afe-9bbe-f658c7c6301c tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Returning 404 to user: Volume e1189feb-0ecc-4313-af03-4f58f76f84a6 could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:28:54.516751 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ac20e620-ceb8-4afe-9bbe-f658c7c6301c tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/e1189feb-0ecc-4313-af03-4f58f76f84a6" status: 404 len: 109 microversion: 2.1 time: 0.068921 Dec 20 03:28:54.518575 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1c5073b8-f4f5-448b-a02a-4739f17bf716 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1290 microversion: 2.1 time: 0.153750 Dec 20 03:28:54.522464 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 35/85] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:54 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1290 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:54.523835 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 51/86] 10.222.0.53 () {58 vars in 1244 bytes} [Mon Dec 20 03:28:54 2021] GET /compute/v2.1/os-volumes/e1189feb-0ecc-4313-af03-4f58f76f84a6 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:28:54.531977 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d8f0e228-f5bd-4d83-a00d-9044040c7d42 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:54.533028 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d8f0e228-f5bd-4d83-a00d-9044040c7d42 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:54.544991 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d8f0e228-f5bd-4d83-a00d-9044040c7d42 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:54.546190 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d8f0e228-f5bd-4d83-a00d-9044040c7d42 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:54.546826 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-008c40f5-83c4-4f57-b2e4-ce4c8589e808 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f4904500dc0>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:54.547892 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d8f0e228-f5bd-4d83-a00d-9044040c7d42 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:54.548683 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d8f0e228-f5bd-4d83-a00d-9044040c7d42 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:54.593709 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-008c40f5-83c4-4f57-b2e4-ce4c8589e808 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] HTTP exception thrown: Volume e1189feb-0ecc-4313-af03-4f58f76f84a6 could not be found. Dec 20 03:28:54.594828 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-008c40f5-83c4-4f57-b2e4-ce4c8589e808 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Returning 404 to user: Volume e1189feb-0ecc-4313-af03-4f58f76f84a6 could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:28:54.595911 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-008c40f5-83c4-4f57-b2e4-ce4c8589e808 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "DELETE /compute/v2.1/os-volumes/e1189feb-0ecc-4313-af03-4f58f76f84a6" status: 404 len: 109 microversion: 2.1 time: 0.053735 Dec 20 03:28:54.596656 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 52/87] 10.222.0.53 () {58 vars in 1247 bytes} [Mon Dec 20 03:28:54 2021] DELETE /compute/v2.1/os-volumes/e1189feb-0ecc-4313-af03-4f58f76f84a6 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 20 03:28:54.615694 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-78985e02-4450-4511-b20a-f85ef39048a2 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Calling method '.version_select at 0x7f4904500c10>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:54.668536 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d8f0e228-f5bd-4d83-a00d-9044040c7d42 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:54.679635 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d8f0e228-f5bd-4d83-a00d-9044040c7d42 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1284 microversion: 2.1 time: 0.155477 Dec 20 03:28:54.685547 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 36/88] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:54 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:54.762399 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-78985e02-4450-4511-b20a-f85ef39048a2 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] HTTP exception thrown: Volume e1189feb-0ecc-4313-af03-4f58f76f84a6 could not be found. Dec 20 03:28:54.762399 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-78985e02-4450-4511-b20a-f85ef39048a2 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] Returning 404 to user: Volume e1189feb-0ecc-4313-af03-4f58f76f84a6 could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:28:54.762399 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-78985e02-4450-4511-b20a-f85ef39048a2 tempest-VolumesSnapshotsTestJSON-1052306350 tempest-VolumesSnapshotsTestJSON-1052306350-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/e1189feb-0ecc-4313-af03-4f58f76f84a6" status: 404 len: 109 microversion: 2.1 time: 0.153224 Dec 20 03:28:54.762399 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 53/89] 10.222.0.53 () {58 vars in 1244 bytes} [Mon Dec 20 03:28:54 2021] GET /compute/v2.1/os-volumes/e1189feb-0ecc-4313-af03-4f58f76f84a6 => generated 109 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:28:55.293910 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-69a92052-79f7-43c9-8435-b42037f0f028 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:55.295727 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-69a92052-79f7-43c9-8435-b42037f0f028 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:55.307740 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-69a92052-79f7-43c9-8435-b42037f0f028 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:55.310635 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-69a92052-79f7-43c9-8435-b42037f0f028 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:55.310635 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-69a92052-79f7-43c9-8435-b42037f0f028 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:55.311223 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-69a92052-79f7-43c9-8435-b42037f0f028 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:55.550301 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-3f17429a-70fc-467e-93e4-a1717f9dd9ab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:55.550301 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-3f17429a-70fc-467e-93e4-a1717f9dd9ab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:55.589663 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3f17429a-70fc-467e-93e4-a1717f9dd9ab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:55.593644 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3f17429a-70fc-467e-93e4-a1717f9dd9ab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:55.593644 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3f17429a-70fc-467e-93e4-a1717f9dd9ab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:55.598723 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3f17429a-70fc-467e-93e4-a1717f9dd9ab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:55.756182 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-69a92052-79f7-43c9-8435-b42037f0f028 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:55.777692 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-69a92052-79f7-43c9-8435-b42037f0f028 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.495273 Dec 20 03:28:55.782058 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 37/90] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:55 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:55.797202 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-73d06a9e-583b-4cf2-9cec-5e9eaea7c303 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:55.797202 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-73d06a9e-583b-4cf2-9cec-5e9eaea7c303 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:55.818204 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-3f17429a-70fc-467e-93e4-a1717f9dd9ab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:55.844548 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-73d06a9e-583b-4cf2-9cec-5e9eaea7c303 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:55.847647 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-73d06a9e-583b-4cf2-9cec-5e9eaea7c303 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:55.851375 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-3f17429a-70fc-467e-93e4-a1717f9dd9ab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1290 microversion: 2.1 time: 0.307371 Dec 20 03:28:55.855382 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-73d06a9e-583b-4cf2-9cec-5e9eaea7c303 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:55.855733 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 54/91] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:55 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1290 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:55.857660 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-73d06a9e-583b-4cf2-9cec-5e9eaea7c303 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:55.972247 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-73d06a9e-583b-4cf2-9cec-5e9eaea7c303 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:55.987419 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-73d06a9e-583b-4cf2-9cec-5e9eaea7c303 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1284 microversion: 2.1 time: 0.199697 Dec 20 03:28:55.999357 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 38/92] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:55 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1284 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:56.808944 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-5867f6dd-2e68-423e-a9c0-6ff947627ab4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:56.809858 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-5867f6dd-2e68-423e-a9c0-6ff947627ab4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:56.823539 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5867f6dd-2e68-423e-a9c0-6ff947627ab4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:56.824698 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5867f6dd-2e68-423e-a9c0-6ff947627ab4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:56.826197 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5867f6dd-2e68-423e-a9c0-6ff947627ab4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:56.826988 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5867f6dd-2e68-423e-a9c0-6ff947627ab4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:56.875113 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-6a08c8f2-cd7c-4b4e-9866-8e79eec792c4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:56.877290 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6a08c8f2-cd7c-4b4e-9866-8e79eec792c4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:56.891405 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6a08c8f2-cd7c-4b4e-9866-8e79eec792c4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:56.892185 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6a08c8f2-cd7c-4b4e-9866-8e79eec792c4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:56.893681 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6a08c8f2-cd7c-4b4e-9866-8e79eec792c4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:56.894706 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6a08c8f2-cd7c-4b4e-9866-8e79eec792c4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:57.038100 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-6a08c8f2-cd7c-4b4e-9866-8e79eec792c4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:57.053604 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-6a08c8f2-cd7c-4b4e-9866-8e79eec792c4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1290 microversion: 2.1 time: 0.187248 Dec 20 03:28:57.064351 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 39/93] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:56 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1290 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:57.070263 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7667d1b5-970f-4625-aa17-d2236ee0cf6c tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:57.071211 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-7667d1b5-970f-4625-aa17-d2236ee0cf6c tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:57.078075 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7667d1b5-970f-4625-aa17-d2236ee0cf6c tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:57.078810 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7667d1b5-970f-4625-aa17-d2236ee0cf6c tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:57.079838 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7667d1b5-970f-4625-aa17-d2236ee0cf6c tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:57.080525 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7667d1b5-970f-4625-aa17-d2236ee0cf6c tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:57.090878 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-5867f6dd-2e68-423e-a9c0-6ff947627ab4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:57.110360 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-5867f6dd-2e68-423e-a9c0-6ff947627ab4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.305194 Dec 20 03:28:57.111503 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 55/94] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:56 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:57.218490 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7667d1b5-970f-4625-aa17-d2236ee0cf6c tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:57.255049 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7667d1b5-970f-4625-aa17-d2236ee0cf6c tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1284 microversion: 2.1 time: 0.188071 Dec 20 03:28:57.257208 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 40/95] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:57 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:58.073385 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-13e5dc96-eb71-4f50-8947-913c1450271e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:58.074727 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-13e5dc96-eb71-4f50-8947-913c1450271e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:58.084365 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-13e5dc96-eb71-4f50-8947-913c1450271e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:58.085048 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-13e5dc96-eb71-4f50-8947-913c1450271e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:58.086307 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-13e5dc96-eb71-4f50-8947-913c1450271e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:58.086907 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-13e5dc96-eb71-4f50-8947-913c1450271e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:58.132930 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7b151179-66da-4200-bde5-c41ca36f09bf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:58.135056 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-7b151179-66da-4200-bde5-c41ca36f09bf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:58.147409 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7b151179-66da-4200-bde5-c41ca36f09bf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:58.147703 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7b151179-66da-4200-bde5-c41ca36f09bf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:58.148763 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7b151179-66da-4200-bde5-c41ca36f09bf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:58.149284 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7b151179-66da-4200-bde5-c41ca36f09bf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:58.226011 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-13e5dc96-eb71-4f50-8947-913c1450271e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:58.252977 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-13e5dc96-eb71-4f50-8947-913c1450271e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1290 microversion: 2.1 time: 0.185297 Dec 20 03:28:58.254709 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 56/96] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:58 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1290 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:58.284633 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d1272ff8-a454-4a8d-9dd6-efa43eb2b2bf tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:58.287480 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d1272ff8-a454-4a8d-9dd6-efa43eb2b2bf tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:58.298822 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d1272ff8-a454-4a8d-9dd6-efa43eb2b2bf tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:58.300033 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d1272ff8-a454-4a8d-9dd6-efa43eb2b2bf tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:58.301855 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d1272ff8-a454-4a8d-9dd6-efa43eb2b2bf tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:58.303453 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d1272ff8-a454-4a8d-9dd6-efa43eb2b2bf tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:58.400218 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7b151179-66da-4200-bde5-c41ca36f09bf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:58.426190 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d1272ff8-a454-4a8d-9dd6-efa43eb2b2bf tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:58.434213 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7b151179-66da-4200-bde5-c41ca36f09bf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.308447 Dec 20 03:28:58.440015 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 41/97] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:58 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:28:58.458258 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d1272ff8-a454-4a8d-9dd6-efa43eb2b2bf tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1284 microversion: 2.1 time: 0.186548 Dec 20 03:28:58.460726 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 57/98] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:58 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:28:59.281402 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-607836ed-275d-4ad6-b15e-a78a1ecae5cf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:59.293901 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-607836ed-275d-4ad6-b15e-a78a1ecae5cf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:59.293901 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-607836ed-275d-4ad6-b15e-a78a1ecae5cf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:59.293901 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-607836ed-275d-4ad6-b15e-a78a1ecae5cf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:59.293901 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-607836ed-275d-4ad6-b15e-a78a1ecae5cf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:59.294531 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-607836ed-275d-4ad6-b15e-a78a1ecae5cf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:59.395772 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-607836ed-275d-4ad6-b15e-a78a1ecae5cf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:59.410879 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-607836ed-275d-4ad6-b15e-a78a1ecae5cf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1290 microversion: 2.1 time: 0.133736 Dec 20 03:28:59.421732 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 42/99] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:59 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1290 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:28:59.472955 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ed5cd6ac-ba96-4ce1-9bfd-37d26e1621dc tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:59.474286 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ed5cd6ac-ba96-4ce1-9bfd-37d26e1621dc tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:59.483988 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1b54dca8-e445-4b93-96e1-0ac66d975d0d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:28:59.485174 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1b54dca8-e445-4b93-96e1-0ac66d975d0d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:28:59.502209 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ed5cd6ac-ba96-4ce1-9bfd-37d26e1621dc tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:59.502692 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ed5cd6ac-ba96-4ce1-9bfd-37d26e1621dc tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:59.503574 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ed5cd6ac-ba96-4ce1-9bfd-37d26e1621dc tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:59.504407 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ed5cd6ac-ba96-4ce1-9bfd-37d26e1621dc tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:59.513409 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1b54dca8-e445-4b93-96e1-0ac66d975d0d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:59.516476 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1b54dca8-e445-4b93-96e1-0ac66d975d0d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:59.522800 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1b54dca8-e445-4b93-96e1-0ac66d975d0d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:28:59.524002 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1b54dca8-e445-4b93-96e1-0ac66d975d0d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:28:59.686818 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1b54dca8-e445-4b93-96e1-0ac66d975d0d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:59.718496 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1b54dca8-e445-4b93-96e1-0ac66d975d0d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1284 microversion: 2.1 time: 0.240566 Dec 20 03:28:59.724910 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 43/100] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:59 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1284 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:28:59.761743 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ed5cd6ac-ba96-4ce1-9bfd-37d26e1621dc tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:28:59.772381 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ed5cd6ac-ba96-4ce1-9bfd-37d26e1621dc tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.305977 Dec 20 03:28:59.783583 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 58/101] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:28:59 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:00.447400 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f2934e9d-537d-4964-9aa8-1336b98a87d5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:00.449748 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f2934e9d-537d-4964-9aa8-1336b98a87d5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:00.463544 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f2934e9d-537d-4964-9aa8-1336b98a87d5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:00.464879 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f2934e9d-537d-4964-9aa8-1336b98a87d5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:00.467809 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f2934e9d-537d-4964-9aa8-1336b98a87d5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:00.468629 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f2934e9d-537d-4964-9aa8-1336b98a87d5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:00.574438 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-f2934e9d-537d-4964-9aa8-1336b98a87d5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:00.591159 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f2934e9d-537d-4964-9aa8-1336b98a87d5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1290 microversion: 2.1 time: 0.149759 Dec 20 03:29:00.591159 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 44/102] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:00 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1290 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:00.743781 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-aad281ae-6678-47e2-a3b7-fe9f5ba9a79d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:00.743781 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-aad281ae-6678-47e2-a3b7-fe9f5ba9a79d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:00.754282 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-aad281ae-6678-47e2-a3b7-fe9f5ba9a79d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:00.755705 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-aad281ae-6678-47e2-a3b7-fe9f5ba9a79d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:00.758422 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-aad281ae-6678-47e2-a3b7-fe9f5ba9a79d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:00.759925 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-aad281ae-6678-47e2-a3b7-fe9f5ba9a79d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:00.795239 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c7511112-3c72-4d57-a7f0-6c041f272423 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:00.796335 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c7511112-3c72-4d57-a7f0-6c041f272423 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:00.844172 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c7511112-3c72-4d57-a7f0-6c041f272423 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:00.849556 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c7511112-3c72-4d57-a7f0-6c041f272423 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:00.853997 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c7511112-3c72-4d57-a7f0-6c041f272423 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:00.854720 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c7511112-3c72-4d57-a7f0-6c041f272423 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:00.952045 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-aad281ae-6678-47e2-a3b7-fe9f5ba9a79d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:00.966593 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-aad281ae-6678-47e2-a3b7-fe9f5ba9a79d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1284 microversion: 2.1 time: 0.231898 Dec 20 03:29:00.969783 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 59/103] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:00 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1284 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:01.264908 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c7511112-3c72-4d57-a7f0-6c041f272423 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:01.280944 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c7511112-3c72-4d57-a7f0-6c041f272423 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.492849 Dec 20 03:29:01.281932 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 45/104] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:00 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:01.614842 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-81762186-ac93-4a03-b5ee-33c89c5d4429 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:01.615767 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-81762186-ac93-4a03-b5ee-33c89c5d4429 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:01.626604 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-81762186-ac93-4a03-b5ee-33c89c5d4429 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:01.631090 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-81762186-ac93-4a03-b5ee-33c89c5d4429 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:01.631090 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-81762186-ac93-4a03-b5ee-33c89c5d4429 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:01.631090 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-81762186-ac93-4a03-b5ee-33c89c5d4429 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:01.733369 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-81762186-ac93-4a03-b5ee-33c89c5d4429 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:01.756459 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-81762186-ac93-4a03-b5ee-33c89c5d4429 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1290 microversion: 2.1 time: 0.143668 Dec 20 03:29:01.764069 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 60/105] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:01 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1290 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:01.998708 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c800b00c-e3ca-44d7-b1f1-9d153ec6f898 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:01.999449 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c800b00c-e3ca-44d7-b1f1-9d153ec6f898 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:02.016793 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c800b00c-e3ca-44d7-b1f1-9d153ec6f898 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:02.017438 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c800b00c-e3ca-44d7-b1f1-9d153ec6f898 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:02.018675 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c800b00c-e3ca-44d7-b1f1-9d153ec6f898 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:02.019378 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c800b00c-e3ca-44d7-b1f1-9d153ec6f898 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:02.105239 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c800b00c-e3ca-44d7-b1f1-9d153ec6f898 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:02.125585 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c800b00c-e3ca-44d7-b1f1-9d153ec6f898 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1284 microversion: 2.1 time: 0.130643 Dec 20 03:29:02.127167 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 46/106] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:01 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:02.320383 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b3eb6fa5-06ee-462b-962d-d56ab399d008 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:02.320996 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-b3eb6fa5-06ee-462b-962d-d56ab399d008 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:02.327385 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b3eb6fa5-06ee-462b-962d-d56ab399d008 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:02.327828 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b3eb6fa5-06ee-462b-962d-d56ab399d008 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:02.328672 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b3eb6fa5-06ee-462b-962d-d56ab399d008 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:02.329521 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b3eb6fa5-06ee-462b-962d-d56ab399d008 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:02.488030 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b3eb6fa5-06ee-462b-962d-d56ab399d008 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:02.495739 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b3eb6fa5-06ee-462b-962d-d56ab399d008 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.180409 Dec 20 03:29:02.496332 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 61/107] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:02 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:02.789027 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f4adeeca-c630-42f9-934c-7848a6c8b785 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:02.793245 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f4adeeca-c630-42f9-934c-7848a6c8b785 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:02.808884 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f4adeeca-c630-42f9-934c-7848a6c8b785 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:02.809371 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f4adeeca-c630-42f9-934c-7848a6c8b785 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:02.810179 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f4adeeca-c630-42f9-934c-7848a6c8b785 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:02.810619 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f4adeeca-c630-42f9-934c-7848a6c8b785 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:02.922610 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-f4adeeca-c630-42f9-934c-7848a6c8b785 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:02.940781 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f4adeeca-c630-42f9-934c-7848a6c8b785 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1290 microversion: 2.1 time: 0.161348 Dec 20 03:29:02.942266 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 47/108] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:02 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1290 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:03.145181 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-6aa5dffe-da43-4f9d-94f2-eacdad9fd6ff tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:03.146101 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6aa5dffe-da43-4f9d-94f2-eacdad9fd6ff tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:03.157487 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6aa5dffe-da43-4f9d-94f2-eacdad9fd6ff tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:03.157926 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6aa5dffe-da43-4f9d-94f2-eacdad9fd6ff tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:03.160590 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6aa5dffe-da43-4f9d-94f2-eacdad9fd6ff tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:03.164178 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6aa5dffe-da43-4f9d-94f2-eacdad9fd6ff tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:03.356778 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6aa5dffe-da43-4f9d-94f2-eacdad9fd6ff tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:03.371808 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-6aa5dffe-da43-4f9d-94f2-eacdad9fd6ff tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1272 microversion: 2.1 time: 0.230286 Dec 20 03:29:03.373494 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 62/109] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:03 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1272 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:03.516750 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1ea05339-abaa-4829-baf0-d76108ec3886 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:03.518676 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1ea05339-abaa-4829-baf0-d76108ec3886 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:03.531300 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1ea05339-abaa-4829-baf0-d76108ec3886 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:03.532445 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1ea05339-abaa-4829-baf0-d76108ec3886 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:03.534624 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1ea05339-abaa-4829-baf0-d76108ec3886 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:03.535793 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1ea05339-abaa-4829-baf0-d76108ec3886 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:03.962698 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-24c7dcb8-0771-4bc4-9a7b-e3d983fcea6a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:03.964305 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-24c7dcb8-0771-4bc4-9a7b-e3d983fcea6a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:03.990673 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-24c7dcb8-0771-4bc4-9a7b-e3d983fcea6a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:03.996633 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-24c7dcb8-0771-4bc4-9a7b-e3d983fcea6a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:04.001547 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-24c7dcb8-0771-4bc4-9a7b-e3d983fcea6a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:04.004040 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-24c7dcb8-0771-4bc4-9a7b-e3d983fcea6a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:04.078897 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1ea05339-abaa-4829-baf0-d76108ec3886 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:04.112319 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1ea05339-abaa-4829-baf0-d76108ec3886 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.599072 Dec 20 03:29:04.118943 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 48/110] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:03 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:04.189461 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-24c7dcb8-0771-4bc4-9a7b-e3d983fcea6a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:04.206648 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-24c7dcb8-0771-4bc4-9a7b-e3d983fcea6a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1308 microversion: 2.1 time: 0.252099 Dec 20 03:29:04.230154 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 63/111] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:03 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1308 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:04.401016 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-3506330b-4d34-448c-adbf-d8663297274a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:04.402310 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-3506330b-4d34-448c-adbf-d8663297274a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:04.415578 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3506330b-4d34-448c-adbf-d8663297274a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:04.418441 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3506330b-4d34-448c-adbf-d8663297274a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:04.421408 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3506330b-4d34-448c-adbf-d8663297274a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:04.422197 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3506330b-4d34-448c-adbf-d8663297274a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:04.675515 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-3506330b-4d34-448c-adbf-d8663297274a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:04.690458 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-3506330b-4d34-448c-adbf-d8663297274a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1272 microversion: 2.1 time: 0.293716 Dec 20 03:29:04.691511 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 49/112] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:04 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1272 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:05.152688 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-62f88685-4450-4915-82b3-f11eb2226441 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:05.156873 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-62f88685-4450-4915-82b3-f11eb2226441 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:05.174843 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-62f88685-4450-4915-82b3-f11eb2226441 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:05.175647 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-62f88685-4450-4915-82b3-f11eb2226441 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:05.178765 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-62f88685-4450-4915-82b3-f11eb2226441 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:05.179964 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-62f88685-4450-4915-82b3-f11eb2226441 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:05.245126 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-4e0b3ae8-7c32-4764-a086-fa979a6d47fa tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:05.246288 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-4e0b3ae8-7c32-4764-a086-fa979a6d47fa tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:05.258024 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4e0b3ae8-7c32-4764-a086-fa979a6d47fa tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:05.259207 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4e0b3ae8-7c32-4764-a086-fa979a6d47fa tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:05.261159 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4e0b3ae8-7c32-4764-a086-fa979a6d47fa tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:05.262437 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4e0b3ae8-7c32-4764-a086-fa979a6d47fa tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:05.519023 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-4e0b3ae8-7c32-4764-a086-fa979a6d47fa tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:05.552376 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-4e0b3ae8-7c32-4764-a086-fa979a6d47fa tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1296 microversion: 2.1 time: 0.314568 Dec 20 03:29:05.571311 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 50/113] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:05 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1296 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:05.579527 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-62f88685-4450-4915-82b3-f11eb2226441 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:05.596550 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-62f88685-4450-4915-82b3-f11eb2226441 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.453479 Dec 20 03:29:05.616105 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 64/114] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:05 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:05.725093 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-c087a120-24a0-4bb8-8bcd-24f621429ed4 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:05.730427 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-c087a120-24a0-4bb8-8bcd-24f621429ed4 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:05.805899 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c087a120-24a0-4bb8-8bcd-24f621429ed4 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:05.815572 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c087a120-24a0-4bb8-8bcd-24f621429ed4 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:05.817172 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c087a120-24a0-4bb8-8bcd-24f621429ed4 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:05.821636 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c087a120-24a0-4bb8-8bcd-24f621429ed4 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:05.940052 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-ccf7451b-5574-4345-9eb9-d2f3793f80a9 req-f921a82a-5f5a-4e10-ad3b-2ca94f5a850e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4d04a54-3696-41b9-95d8-aa2624b21b17", "tag": "aa010647-2532-4b5c-ba09-88875560b47b"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:05.948011 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:29:05.948011 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:29:05.996941 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-ccf7451b-5574-4345-9eb9-d2f3793f80a9 req-f921a82a-5f5a-4e10-ad3b-2ca94f5a850e service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:05.997772 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-ccf7451b-5574-4345-9eb9-d2f3793f80a9 req-f921a82a-5f5a-4e10-ad3b-2ca94f5a850e service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:06.082587 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-ccf7451b-5574-4345-9eb9-d2f3793f80a9 req-f921a82a-5f5a-4e10-ad3b-2ca94f5a850e service nova] Creating event network-changed:aa010647-2532-4b5c-ba09-88875560b47b for instance f4d04a54-3696-41b9-95d8-aa2624b21b17 on hv-cinder-81803 Dec 20 03:29:06.082587 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-ccf7451b-5574-4345-9eb9-d2f3793f80a9 req-f921a82a-5f5a-4e10-ad3b-2ca94f5a850e service nova] Acquired lock "compute-rpcapi-router" {{(pid=117012) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 20 03:29:06.082587 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7f9d2cbd-ed0a-4581-8f1f-68f2e691bc33 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:06.082587 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7f9d2cbd-ed0a-4581-8f1f-68f2e691bc33 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:06.082587 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7f9d2cbd-ed0a-4581-8f1f-68f2e691bc33 None None] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:06.082981 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7f9d2cbd-ed0a-4581-8f1f-68f2e691bc33 None None] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:06.094598 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.compute.rpcapi [None req-7f9d2cbd-ed0a-4581-8f1f-68f2e691bc33 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 20 03:29:06.095832 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7f9d2cbd-ed0a-4581-8f1f-68f2e691bc33 None None] Releasing lock "compute-rpcapi-router" {{(pid=117012) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 20 03:29:06.152989 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7f9d2cbd-ed0a-4581-8f1f-68f2e691bc33 None None] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.462393 Dec 20 03:29:06.156316 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 51/115] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:29:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:29:06.300518 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-c087a120-24a0-4bb8-8bcd-24f621429ed4 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:06.317266 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-c087a120-24a0-4bb8-8bcd-24f621429ed4 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1314 microversion: 2.1 time: 0.598066 Dec 20 03:29:06.319195 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 65/116] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:05 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:06.582481 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-9d68c3f1-a261-4c74-9012-ccc09bca5912 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:06.584058 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-9d68c3f1-a261-4c74-9012-ccc09bca5912 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:06.591852 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9d68c3f1-a261-4c74-9012-ccc09bca5912 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:06.592303 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9d68c3f1-a261-4c74-9012-ccc09bca5912 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:06.593113 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9d68c3f1-a261-4c74-9012-ccc09bca5912 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:06.593590 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9d68c3f1-a261-4c74-9012-ccc09bca5912 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:06.625229 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-3b36df1d-48ba-4ad1-8ca1-27979ded7219 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:06.626302 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-3b36df1d-48ba-4ad1-8ca1-27979ded7219 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:06.634602 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3b36df1d-48ba-4ad1-8ca1-27979ded7219 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:06.635418 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3b36df1d-48ba-4ad1-8ca1-27979ded7219 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:06.636609 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3b36df1d-48ba-4ad1-8ca1-27979ded7219 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:06.637248 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3b36df1d-48ba-4ad1-8ca1-27979ded7219 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:06.835744 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-9d68c3f1-a261-4c74-9012-ccc09bca5912 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:06.849912 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-9d68c3f1-a261-4c74-9012-ccc09bca5912 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1363 microversion: 2.1 time: 0.271530 Dec 20 03:29:06.859979 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 52/117] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:06 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:06.900893 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-3b36df1d-48ba-4ad1-8ca1-27979ded7219 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:06.913076 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-3b36df1d-48ba-4ad1-8ca1-27979ded7219 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.292031 Dec 20 03:29:06.921244 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 66/118] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:06 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:07.339104 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-0961bf78-5bfd-457d-b185-d200b3d78b86 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:07.340307 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-0961bf78-5bfd-457d-b185-d200b3d78b86 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:07.355372 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0961bf78-5bfd-457d-b185-d200b3d78b86 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:07.356110 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0961bf78-5bfd-457d-b185-d200b3d78b86 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:07.357483 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0961bf78-5bfd-457d-b185-d200b3d78b86 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:07.358206 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0961bf78-5bfd-457d-b185-d200b3d78b86 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:07.594170 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0961bf78-5bfd-457d-b185-d200b3d78b86 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:07.610288 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-0961bf78-5bfd-457d-b185-d200b3d78b86 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1314 microversion: 2.1 time: 0.277592 Dec 20 03:29:07.611838 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 53/119] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:07 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:07.870704 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-fed304cb-adf2-495e-9a73-41f65b2ec892 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:07.876221 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-fed304cb-adf2-495e-9a73-41f65b2ec892 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:07.879818 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fed304cb-adf2-495e-9a73-41f65b2ec892 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:07.884681 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fed304cb-adf2-495e-9a73-41f65b2ec892 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:07.886913 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fed304cb-adf2-495e-9a73-41f65b2ec892 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:07.890177 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fed304cb-adf2-495e-9a73-41f65b2ec892 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:07.937244 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7b72550b-c9a8-417a-8586-0615b9650f2f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:07.937929 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-7b72550b-c9a8-417a-8586-0615b9650f2f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:07.947368 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7b72550b-c9a8-417a-8586-0615b9650f2f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:07.948063 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7b72550b-c9a8-417a-8586-0615b9650f2f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:07.948873 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7b72550b-c9a8-417a-8586-0615b9650f2f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:07.949481 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7b72550b-c9a8-417a-8586-0615b9650f2f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:08.447940 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-fed304cb-adf2-495e-9a73-41f65b2ec892 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:08.472140 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-fed304cb-adf2-495e-9a73-41f65b2ec892 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1363 microversion: 2.1 time: 0.607824 Dec 20 03:29:08.496093 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 67/120] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:07 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1363 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:08.628684 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-268efcdf-ab2f-48d9-bddd-b005ecce129f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:08.636223 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-268efcdf-ab2f-48d9-bddd-b005ecce129f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:08.636694 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7b72550b-c9a8-417a-8586-0615b9650f2f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:08.647311 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7b72550b-c9a8-417a-8586-0615b9650f2f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.715038 Dec 20 03:29:08.649808 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-268efcdf-ab2f-48d9-bddd-b005ecce129f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:08.650434 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 54/121] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:07 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:08.651103 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-268efcdf-ab2f-48d9-bddd-b005ecce129f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:08.652124 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-268efcdf-ab2f-48d9-bddd-b005ecce129f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:08.652638 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-268efcdf-ab2f-48d9-bddd-b005ecce129f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:09.334622 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-268efcdf-ab2f-48d9-bddd-b005ecce129f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:09.352775 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-268efcdf-ab2f-48d9-bddd-b005ecce129f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1314 microversion: 2.1 time: 0.727519 Dec 20 03:29:09.361228 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 68/122] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:08 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1314 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:09.506545 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-b33df195-75ae-4b6b-8f0a-3b7c585c36f2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:09.507655 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-b33df195-75ae-4b6b-8f0a-3b7c585c36f2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:09.523394 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b33df195-75ae-4b6b-8f0a-3b7c585c36f2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:09.524539 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b33df195-75ae-4b6b-8f0a-3b7c585c36f2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:09.526104 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b33df195-75ae-4b6b-8f0a-3b7c585c36f2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:09.528037 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b33df195-75ae-4b6b-8f0a-3b7c585c36f2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:09.665295 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-59601963-953c-4094-8836-217570fe61a4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:09.666264 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-59601963-953c-4094-8836-217570fe61a4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:09.679014 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-59601963-953c-4094-8836-217570fe61a4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:09.679971 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-59601963-953c-4094-8836-217570fe61a4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:09.681640 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-59601963-953c-4094-8836-217570fe61a4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:09.686502 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-59601963-953c-4094-8836-217570fe61a4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:09.867090 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-b33df195-75ae-4b6b-8f0a-3b7c585c36f2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:09.899608 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-b33df195-75ae-4b6b-8f0a-3b7c585c36f2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1363 microversion: 2.1 time: 0.396250 Dec 20 03:29:09.900523 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 55/123] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:09 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1363 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:10.521896 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-5052160d-f2b3-4432-8179-72fb8e540788 req-7cb4f224-dda2-4c6b-b317-8da07444f6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "162a716d-d00f-4a5a-afc8-ff3f430a8e02", "tag": "62ed6e5b-3c1f-49fa-b6a4-bf7a8952539f"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:10.524031 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:29:10.524031 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:29:10.536296 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-5052160d-f2b3-4432-8179-72fb8e540788 req-7cb4f224-dda2-4c6b-b317-8da07444f6f8 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:10.539005 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-5052160d-f2b3-4432-8179-72fb8e540788 req-7cb4f224-dda2-4c6b-b317-8da07444f6f8 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:10.588584 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-5052160d-f2b3-4432-8179-72fb8e540788 req-7cb4f224-dda2-4c6b-b317-8da07444f6f8 service nova] Creating event network-changed:62ed6e5b-3c1f-49fa-b6a4-bf7a8952539f for instance 162a716d-d00f-4a5a-afc8-ff3f430a8e02 on hv-cinder-81803 Dec 20 03:29:10.605112 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-5052160d-f2b3-4432-8179-72fb8e540788 req-7cb4f224-dda2-4c6b-b317-8da07444f6f8 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.401649 Dec 20 03:29:10.612094 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 56/124] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:29:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:29:10.624919 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-cbf4656b-efa0-4058-94fe-2f9d6896494e tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:10.626093 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-cbf4656b-efa0-4058-94fe-2f9d6896494e tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:10.635270 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cbf4656b-efa0-4058-94fe-2f9d6896494e tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:10.641757 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cbf4656b-efa0-4058-94fe-2f9d6896494e tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:10.641757 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cbf4656b-efa0-4058-94fe-2f9d6896494e tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:10.641757 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cbf4656b-efa0-4058-94fe-2f9d6896494e tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:10.659782 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-59601963-953c-4094-8836-217570fe61a4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:10.678636 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-59601963-953c-4094-8836-217570fe61a4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 1.014072 Dec 20 03:29:10.683290 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 69/125] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:09 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:10.835979 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-cbf4656b-efa0-4058-94fe-2f9d6896494e tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:10.852482 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-cbf4656b-efa0-4058-94fe-2f9d6896494e tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1314 microversion: 2.1 time: 0.234204 Dec 20 03:29:10.855283 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 57/126] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:10 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:10.926279 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-3fe06daf-a716-4cf1-899c-c3d3ea41fda1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:10.926962 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-3fe06daf-a716-4cf1-899c-c3d3ea41fda1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:10.934488 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3fe06daf-a716-4cf1-899c-c3d3ea41fda1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:10.935178 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3fe06daf-a716-4cf1-899c-c3d3ea41fda1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:10.936109 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3fe06daf-a716-4cf1-899c-c3d3ea41fda1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:10.936516 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3fe06daf-a716-4cf1-899c-c3d3ea41fda1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:11.314681 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-3fe06daf-a716-4cf1-899c-c3d3ea41fda1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:11.331773 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-3fe06daf-a716-4cf1-899c-c3d3ea41fda1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1363 microversion: 2.1 time: 0.410234 Dec 20 03:29:11.334075 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 70/127] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:10 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1363 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:11.721119 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-8b1df202-34dd-4d00-8e1f-91f61f1379f6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:11.727354 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-8b1df202-34dd-4d00-8e1f-91f61f1379f6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:11.758019 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8b1df202-34dd-4d00-8e1f-91f61f1379f6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:11.759003 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8b1df202-34dd-4d00-8e1f-91f61f1379f6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:11.761372 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8b1df202-34dd-4d00-8e1f-91f61f1379f6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:11.762693 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8b1df202-34dd-4d00-8e1f-91f61f1379f6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:11.887364 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-41c502a4-360c-419b-8163-3e23e327b083 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:11.890544 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-41c502a4-360c-419b-8163-3e23e327b083 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:11.907716 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-41c502a4-360c-419b-8163-3e23e327b083 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:11.908441 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-41c502a4-360c-419b-8163-3e23e327b083 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:11.909998 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-41c502a4-360c-419b-8163-3e23e327b083 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:11.910718 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-41c502a4-360c-419b-8163-3e23e327b083 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:12.043548 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-8b1df202-34dd-4d00-8e1f-91f61f1379f6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:12.069313 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-8b1df202-34dd-4d00-8e1f-91f61f1379f6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.365514 Dec 20 03:29:12.076416 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 58/128] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:11 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:12.357994 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-2ccdccf5-30e9-4b74-9784-da283daba87c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:12.359135 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-2ccdccf5-30e9-4b74-9784-da283daba87c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:12.369983 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2ccdccf5-30e9-4b74-9784-da283daba87c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:12.371221 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2ccdccf5-30e9-4b74-9784-da283daba87c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:12.372800 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2ccdccf5-30e9-4b74-9784-da283daba87c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:12.374097 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2ccdccf5-30e9-4b74-9784-da283daba87c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:12.417668 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-41c502a4-360c-419b-8163-3e23e327b083 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:12.442217 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-41c502a4-360c-419b-8163-3e23e327b083 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1314 microversion: 2.1 time: 0.549363 Dec 20 03:29:12.442217 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 71/129] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:11 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:12.705396 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-e7d31b20-7892-4f65-b7e0-fa0a1392057d req-6675c98d-5a22-4c11-937f-1563897814fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ec437d6-633a-468c-aa6a-d4c81df62919", "tag": "8052eace-4c6b-4e95-b6b9-e785e74cfa8a"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:12.705396 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:29:12.705396 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:29:12.705396 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-e7d31b20-7892-4f65-b7e0-fa0a1392057d req-6675c98d-5a22-4c11-937f-1563897814fe service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:12.705396 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-e7d31b20-7892-4f65-b7e0-fa0a1392057d req-6675c98d-5a22-4c11-937f-1563897814fe service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:12.719917 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-e7d31b20-7892-4f65-b7e0-fa0a1392057d req-6675c98d-5a22-4c11-937f-1563897814fe service nova] Creating event network-changed:8052eace-4c6b-4e95-b6b9-e785e74cfa8a for instance 5ec437d6-633a-468c-aa6a-d4c81df62919 on hv-cinder-81803 Dec 20 03:29:12.721492 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-e7d31b20-7892-4f65-b7e0-fa0a1392057d req-6675c98d-5a22-4c11-937f-1563897814fe service nova] Acquired lock "compute-rpcapi-router" {{(pid=117011) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 20 03:29:12.722901 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b2796c2a-9040-4eef-9bcd-f56d9d9fb087 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:12.723557 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b2796c2a-9040-4eef-9bcd-f56d9d9fb087 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:12.725598 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b2796c2a-9040-4eef-9bcd-f56d9d9fb087 None None] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:12.726583 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b2796c2a-9040-4eef-9bcd-f56d9d9fb087 None None] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:12.747907 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.compute.rpcapi [None req-b2796c2a-9040-4eef-9bcd-f56d9d9fb087 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 20 03:29:12.748832 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b2796c2a-9040-4eef-9bcd-f56d9d9fb087 None None] Releasing lock "compute-rpcapi-router" {{(pid=117011) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 20 03:29:12.772239 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-2ccdccf5-30e9-4b74-9784-da283daba87c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:12.780201 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b2796c2a-9040-4eef-9bcd-f56d9d9fb087 None None] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134915 Dec 20 03:29:12.781104 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 72/130] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:29:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:29:12.789562 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-2ccdccf5-30e9-4b74-9784-da283daba87c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1363 microversion: 2.1 time: 0.438066 Dec 20 03:29:12.805529 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 59/131] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:12 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1363 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:13.097853 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e6c98d50-ddf1-4afc-bf1e-5233be3ff2c0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:13.098432 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e6c98d50-ddf1-4afc-bf1e-5233be3ff2c0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:13.105834 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e6c98d50-ddf1-4afc-bf1e-5233be3ff2c0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:13.106272 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e6c98d50-ddf1-4afc-bf1e-5233be3ff2c0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:13.107228 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e6c98d50-ddf1-4afc-bf1e-5233be3ff2c0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:13.107728 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e6c98d50-ddf1-4afc-bf1e-5233be3ff2c0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:13.258533 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-e6c98d50-ddf1-4afc-bf1e-5233be3ff2c0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:13.273263 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e6c98d50-ddf1-4afc-bf1e-5233be3ff2c0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.179136 Dec 20 03:29:13.274821 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 73/132] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:13 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:13.456048 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-174778c6-d008-4c60-b345-1c753ded8a5b tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:13.457212 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-174778c6-d008-4c60-b345-1c753ded8a5b tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:13.472112 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-174778c6-d008-4c60-b345-1c753ded8a5b tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:13.472293 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-174778c6-d008-4c60-b345-1c753ded8a5b tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:13.473615 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-174778c6-d008-4c60-b345-1c753ded8a5b tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:13.475368 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-174778c6-d008-4c60-b345-1c753ded8a5b tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:13.698466 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-174778c6-d008-4c60-b345-1c753ded8a5b tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:13.707273 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-174778c6-d008-4c60-b345-1c753ded8a5b tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1314 microversion: 2.1 time: 0.260338 Dec 20 03:29:13.707971 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 60/133] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:13 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:13.820600 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-56d189e2-d54c-48f2-9764-692dbf139bae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:13.822168 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-56d189e2-d54c-48f2-9764-692dbf139bae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:13.833318 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-56d189e2-d54c-48f2-9764-692dbf139bae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:13.834686 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-56d189e2-d54c-48f2-9764-692dbf139bae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:13.836504 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-56d189e2-d54c-48f2-9764-692dbf139bae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:13.837399 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-56d189e2-d54c-48f2-9764-692dbf139bae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:14.088533 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-56d189e2-d54c-48f2-9764-692dbf139bae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:14.098407 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-56d189e2-d54c-48f2-9764-692dbf139bae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1363 microversion: 2.1 time: 0.285209 Dec 20 03:29:14.100046 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 74/134] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:13 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:14.298570 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ff5d96b6-ce52-46e4-9bcf-0ef697c18034 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:14.300935 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ff5d96b6-ce52-46e4-9bcf-0ef697c18034 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:14.311928 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ff5d96b6-ce52-46e4-9bcf-0ef697c18034 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:14.315378 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ff5d96b6-ce52-46e4-9bcf-0ef697c18034 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:14.315378 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ff5d96b6-ce52-46e4-9bcf-0ef697c18034 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:14.316244 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ff5d96b6-ce52-46e4-9bcf-0ef697c18034 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:14.641003 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-ff5d96b6-ce52-46e4-9bcf-0ef697c18034 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:14.653977 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ff5d96b6-ce52-46e4-9bcf-0ef697c18034 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.362799 Dec 20 03:29:14.656138 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 61/135] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:14 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:14.726597 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-9194b3ec-db1a-4a86-b483-9d9ad2558604 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:14.727604 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-9194b3ec-db1a-4a86-b483-9d9ad2558604 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:14.738508 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9194b3ec-db1a-4a86-b483-9d9ad2558604 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:14.739284 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9194b3ec-db1a-4a86-b483-9d9ad2558604 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:14.740346 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9194b3ec-db1a-4a86-b483-9d9ad2558604 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:14.742125 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9194b3ec-db1a-4a86-b483-9d9ad2558604 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:15.122918 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-90a2bd22-7486-4655-a97f-52a6d7b49252 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:15.124752 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-90a2bd22-7486-4655-a97f-52a6d7b49252 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:15.137996 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-90a2bd22-7486-4655-a97f-52a6d7b49252 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:15.139427 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-90a2bd22-7486-4655-a97f-52a6d7b49252 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:15.143127 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-90a2bd22-7486-4655-a97f-52a6d7b49252 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:15.144651 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-90a2bd22-7486-4655-a97f-52a6d7b49252 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:15.475156 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9194b3ec-db1a-4a86-b483-9d9ad2558604 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:15.490832 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-9194b3ec-db1a-4a86-b483-9d9ad2558604 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1314 microversion: 2.1 time: 0.767975 Dec 20 03:29:15.500966 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 75/136] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:14 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1314 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:15.569717 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-90a2bd22-7486-4655-a97f-52a6d7b49252 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:15.590163 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-90a2bd22-7486-4655-a97f-52a6d7b49252 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1363 microversion: 2.1 time: 0.475901 Dec 20 03:29:15.593014 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 62/137] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:15 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1363 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:15.676590 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-8d4df1ad-5a24-4bf0-a406-4a4edf0591dd tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:15.679074 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-8d4df1ad-5a24-4bf0-a406-4a4edf0591dd tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:15.698598 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8d4df1ad-5a24-4bf0-a406-4a4edf0591dd tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:15.701454 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8d4df1ad-5a24-4bf0-a406-4a4edf0591dd tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:15.706656 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8d4df1ad-5a24-4bf0-a406-4a4edf0591dd tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:15.707923 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8d4df1ad-5a24-4bf0-a406-4a4edf0591dd tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:16.048860 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-8d4df1ad-5a24-4bf0-a406-4a4edf0591dd tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:16.071003 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-8d4df1ad-5a24-4bf0-a406-4a4edf0591dd tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.401242 Dec 20 03:29:16.073349 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 76/138] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:15 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:16.512071 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-2342673e-00d8-4acf-82fa-71d9ea63a7d8 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:16.513106 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-2342673e-00d8-4acf-82fa-71d9ea63a7d8 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:16.528380 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2342673e-00d8-4acf-82fa-71d9ea63a7d8 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:16.529732 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2342673e-00d8-4acf-82fa-71d9ea63a7d8 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:16.531133 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2342673e-00d8-4acf-82fa-71d9ea63a7d8 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:16.534160 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2342673e-00d8-4acf-82fa-71d9ea63a7d8 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:16.627609 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-9546f735-c309-4025-ae00-a0cfc1009aab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:16.628313 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-9546f735-c309-4025-ae00-a0cfc1009aab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:16.635687 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9546f735-c309-4025-ae00-a0cfc1009aab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:16.636141 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9546f735-c309-4025-ae00-a0cfc1009aab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:16.636975 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9546f735-c309-4025-ae00-a0cfc1009aab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:16.637478 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9546f735-c309-4025-ae00-a0cfc1009aab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:16.812095 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-2342673e-00d8-4acf-82fa-71d9ea63a7d8 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:16.826442 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-2342673e-00d8-4acf-82fa-71d9ea63a7d8 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1314 microversion: 2.1 time: 0.320707 Dec 20 03:29:16.827654 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 63/139] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:16 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:16.841572 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9546f735-c309-4025-ae00-a0cfc1009aab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:16.850681 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-9546f735-c309-4025-ae00-a0cfc1009aab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1363 microversion: 2.1 time: 0.226689 Dec 20 03:29:16.851273 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 77/140] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:16 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:17.101721 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d5f2f803-99bb-4544-ad1c-11f65cd15955 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:17.106647 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d5f2f803-99bb-4544-ad1c-11f65cd15955 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:17.123953 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d5f2f803-99bb-4544-ad1c-11f65cd15955 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:17.124588 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d5f2f803-99bb-4544-ad1c-11f65cd15955 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:17.125691 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d5f2f803-99bb-4544-ad1c-11f65cd15955 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:17.126413 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d5f2f803-99bb-4544-ad1c-11f65cd15955 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:17.374269 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d5f2f803-99bb-4544-ad1c-11f65cd15955 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:17.392897 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d5f2f803-99bb-4544-ad1c-11f65cd15955 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.298502 Dec 20 03:29:17.394570 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 64/141] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:17 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:17.855382 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-2fbec3e4-71d3-468f-afd8-de9cabcd565c tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:17.857734 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-2fbec3e4-71d3-468f-afd8-de9cabcd565c tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:17.873820 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2fbec3e4-71d3-468f-afd8-de9cabcd565c tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:17.874814 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2fbec3e4-71d3-468f-afd8-de9cabcd565c tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:17.876369 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2fbec3e4-71d3-468f-afd8-de9cabcd565c tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:17.877294 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2fbec3e4-71d3-468f-afd8-de9cabcd565c tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:17.881514 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-00ad5c21-0d8e-4cbd-a49f-9a5fe83f6cd2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:17.884552 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-00ad5c21-0d8e-4cbd-a49f-9a5fe83f6cd2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:17.900035 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-00ad5c21-0d8e-4cbd-a49f-9a5fe83f6cd2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:17.901248 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-00ad5c21-0d8e-4cbd-a49f-9a5fe83f6cd2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:17.903206 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-00ad5c21-0d8e-4cbd-a49f-9a5fe83f6cd2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:17.904374 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-00ad5c21-0d8e-4cbd-a49f-9a5fe83f6cd2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:18.127758 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-00ad5c21-0d8e-4cbd-a49f-9a5fe83f6cd2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:18.139078 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-00ad5c21-0d8e-4cbd-a49f-9a5fe83f6cd2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1363 microversion: 2.1 time: 0.269851 Dec 20 03:29:18.140293 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 65/142] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:17 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:18.207462 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-2fbec3e4-71d3-468f-afd8-de9cabcd565c tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:18.220303 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-2fbec3e4-71d3-468f-afd8-de9cabcd565c tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1314 microversion: 2.1 time: 0.374925 Dec 20 03:29:18.232787 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 78/143] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:17 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:18.412946 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-57691dfd-a8c9-4e9d-8165-8f65d7c27030 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:18.413774 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-57691dfd-a8c9-4e9d-8165-8f65d7c27030 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:18.422479 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-57691dfd-a8c9-4e9d-8165-8f65d7c27030 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:18.423016 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-57691dfd-a8c9-4e9d-8165-8f65d7c27030 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:18.423978 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-57691dfd-a8c9-4e9d-8165-8f65d7c27030 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:18.424463 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-57691dfd-a8c9-4e9d-8165-8f65d7c27030 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:18.681487 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-57691dfd-a8c9-4e9d-8165-8f65d7c27030 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:18.698410 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-57691dfd-a8c9-4e9d-8165-8f65d7c27030 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.290118 Dec 20 03:29:18.700381 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 66/144] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:18 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:19.171607 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d1c90c94-ba59-4073-aaf6-638e9a5bb3ef tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:19.174100 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d1c90c94-ba59-4073-aaf6-638e9a5bb3ef tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:19.186121 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d1c90c94-ba59-4073-aaf6-638e9a5bb3ef tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:19.186845 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d1c90c94-ba59-4073-aaf6-638e9a5bb3ef tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:19.188148 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d1c90c94-ba59-4073-aaf6-638e9a5bb3ef tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:19.188853 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d1c90c94-ba59-4073-aaf6-638e9a5bb3ef tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:19.190907 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-27f7eb26-8320-4ab7-9fd0-c4968a7ced3c req-e72f293e-e301-4ae2-91f3-36e0a7c62eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d04a54-3696-41b9-95d8-aa2624b21b17", "name": "network-vif-plugged", "status": "completed", "tag": "aa010647-2532-4b5c-ba09-88875560b47b"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:19.195456 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:29:19.195456 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:29:19.207493 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-27f7eb26-8320-4ab7-9fd0-c4968a7ced3c req-e72f293e-e301-4ae2-91f3-36e0a7c62eda service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:19.209300 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-27f7eb26-8320-4ab7-9fd0-c4968a7ced3c req-e72f293e-e301-4ae2-91f3-36e0a7c62eda service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:19.232789 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-27f7eb26-8320-4ab7-9fd0-c4968a7ced3c req-e72f293e-e301-4ae2-91f3-36e0a7c62eda service nova] Creating event network-vif-plugged:aa010647-2532-4b5c-ba09-88875560b47b for instance f4d04a54-3696-41b9-95d8-aa2624b21b17 on hv-cinder-81803 Dec 20 03:29:19.240808 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-27f7eb26-8320-4ab7-9fd0-c4968a7ced3c req-e72f293e-e301-4ae2-91f3-36e0a7c62eda service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.268007 Dec 20 03:29:19.241838 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 79/145] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:29:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:29:19.251061 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ef063da1-51ee-43a3-9514-261617f22ecd tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:19.252145 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ef063da1-51ee-43a3-9514-261617f22ecd tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:19.263103 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ef063da1-51ee-43a3-9514-261617f22ecd tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:19.263744 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ef063da1-51ee-43a3-9514-261617f22ecd tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:19.269775 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ef063da1-51ee-43a3-9514-261617f22ecd tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:19.269775 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ef063da1-51ee-43a3-9514-261617f22ecd tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:19.478699 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d1c90c94-ba59-4073-aaf6-638e9a5bb3ef tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:19.494957 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d1c90c94-ba59-4073-aaf6-638e9a5bb3ef tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1363 microversion: 2.1 time: 0.329704 Dec 20 03:29:19.496779 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 67/146] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:19 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1363 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:19.532742 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ef063da1-51ee-43a3-9514-261617f22ecd tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:19.547892 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ef063da1-51ee-43a3-9514-261617f22ecd tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1314 microversion: 2.1 time: 0.303114 Dec 20 03:29:19.548891 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 80/147] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:19 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:19.751207 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-bf61677e-4c1c-4e77-a1c6-ab2f78cc62be tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:19.752521 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-bf61677e-4c1c-4e77-a1c6-ab2f78cc62be tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:19.766455 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bf61677e-4c1c-4e77-a1c6-ab2f78cc62be tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:19.766455 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bf61677e-4c1c-4e77-a1c6-ab2f78cc62be tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:19.767947 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bf61677e-4c1c-4e77-a1c6-ab2f78cc62be tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:19.768696 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bf61677e-4c1c-4e77-a1c6-ab2f78cc62be tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:20.037893 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-bf61677e-4c1c-4e77-a1c6-ab2f78cc62be tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:20.066837 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-bf61677e-4c1c-4e77-a1c6-ab2f78cc62be tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.318587 Dec 20 03:29:20.070203 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 68/148] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:19 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:20.519613 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-52340e0b-bc01-44b7-b748-0c1d86b8969c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:20.521409 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-52340e0b-bc01-44b7-b748-0c1d86b8969c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:20.532046 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-52340e0b-bc01-44b7-b748-0c1d86b8969c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:20.532828 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-52340e0b-bc01-44b7-b748-0c1d86b8969c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:20.534295 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-52340e0b-bc01-44b7-b748-0c1d86b8969c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:20.535074 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-52340e0b-bc01-44b7-b748-0c1d86b8969c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:20.577729 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1c24672f-fd6e-43ca-b502-364da7db07ce tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:20.579678 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1c24672f-fd6e-43ca-b502-364da7db07ce tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:20.590728 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1c24672f-fd6e-43ca-b502-364da7db07ce tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:20.591439 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1c24672f-fd6e-43ca-b502-364da7db07ce tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:20.592857 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1c24672f-fd6e-43ca-b502-364da7db07ce tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:20.593658 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1c24672f-fd6e-43ca-b502-364da7db07ce tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:20.789257 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-52340e0b-bc01-44b7-b748-0c1d86b8969c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:20.799849 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-52340e0b-bc01-44b7-b748-0c1d86b8969c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1363 microversion: 2.1 time: 0.287653 Dec 20 03:29:20.800702 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 81/149] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:20 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:20.855081 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1c24672f-fd6e-43ca-b502-364da7db07ce tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:20.865055 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1c24672f-fd6e-43ca-b502-364da7db07ce tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1314 microversion: 2.1 time: 0.293769 Dec 20 03:29:20.866338 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 69/150] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:20 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:21.092110 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-7000e4d6-b260-4d32-9887-6c312a905e88 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:21.093214 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-7000e4d6-b260-4d32-9887-6c312a905e88 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:21.104912 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7000e4d6-b260-4d32-9887-6c312a905e88 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:21.110303 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7000e4d6-b260-4d32-9887-6c312a905e88 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:21.110303 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7000e4d6-b260-4d32-9887-6c312a905e88 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:21.110303 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7000e4d6-b260-4d32-9887-6c312a905e88 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:21.315606 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-7000e4d6-b260-4d32-9887-6c312a905e88 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:21.335238 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-7000e4d6-b260-4d32-9887-6c312a905e88 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.248901 Dec 20 03:29:21.337575 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 82/151] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:21 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:21.828436 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-15e61e0c-c289-49e2-a1cd-f49d09d252eb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:21.830843 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-15e61e0c-c289-49e2-a1cd-f49d09d252eb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:21.853983 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-15e61e0c-c289-49e2-a1cd-f49d09d252eb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:21.854927 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-15e61e0c-c289-49e2-a1cd-f49d09d252eb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:21.856165 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-15e61e0c-c289-49e2-a1cd-f49d09d252eb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:21.856661 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-15e61e0c-c289-49e2-a1cd-f49d09d252eb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:21.894576 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-42335117-5849-47cd-b106-469bc69e6c71 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:21.901687 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-42335117-5849-47cd-b106-469bc69e6c71 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:21.923186 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-42335117-5849-47cd-b106-469bc69e6c71 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:21.923839 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-42335117-5849-47cd-b106-469bc69e6c71 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:21.924817 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-42335117-5849-47cd-b106-469bc69e6c71 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:21.925561 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-42335117-5849-47cd-b106-469bc69e6c71 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:22.277661 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-15e61e0c-c289-49e2-a1cd-f49d09d252eb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:22.306702 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-15e61e0c-c289-49e2-a1cd-f49d09d252eb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1363 microversion: 2.1 time: 0.485000 Dec 20 03:29:22.314574 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 70/152] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:21 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1363 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:22.376454 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-42335117-5849-47cd-b106-469bc69e6c71 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:22.383913 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-8d00d8c6-f88c-4aae-a34d-20a8d0fb491e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:22.384859 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-42335117-5849-47cd-b106-469bc69e6c71 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1314 microversion: 2.1 time: 0.497464 Dec 20 03:29:22.385507 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 83/153] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:21 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:22.389005 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-8d00d8c6-f88c-4aae-a34d-20a8d0fb491e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:22.406769 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8d00d8c6-f88c-4aae-a34d-20a8d0fb491e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:22.408261 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8d00d8c6-f88c-4aae-a34d-20a8d0fb491e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:22.410214 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8d00d8c6-f88c-4aae-a34d-20a8d0fb491e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:22.411259 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8d00d8c6-f88c-4aae-a34d-20a8d0fb491e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:22.647853 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-8d00d8c6-f88c-4aae-a34d-20a8d0fb491e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:22.657403 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-8d00d8c6-f88c-4aae-a34d-20a8d0fb491e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.296888 Dec 20 03:29:22.660101 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 71/154] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:22 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:23.327284 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-4e48e532-502c-4647-80e5-8a8baf491983 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:23.328262 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-4e48e532-502c-4647-80e5-8a8baf491983 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:23.337691 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4e48e532-502c-4647-80e5-8a8baf491983 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:23.338229 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4e48e532-502c-4647-80e5-8a8baf491983 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:23.339024 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4e48e532-502c-4647-80e5-8a8baf491983 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:23.339463 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4e48e532-502c-4647-80e5-8a8baf491983 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:23.413063 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a34b62d6-5fce-4f2e-b4d7-c5e81c45392a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:23.414868 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a34b62d6-5fce-4f2e-b4d7-c5e81c45392a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:23.422283 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a34b62d6-5fce-4f2e-b4d7-c5e81c45392a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:23.422833 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a34b62d6-5fce-4f2e-b4d7-c5e81c45392a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:23.424049 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a34b62d6-5fce-4f2e-b4d7-c5e81c45392a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:23.424838 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a34b62d6-5fce-4f2e-b4d7-c5e81c45392a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:23.524053 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-4e48e532-502c-4647-80e5-8a8baf491983 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:23.543892 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-4e48e532-502c-4647-80e5-8a8baf491983 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1363 microversion: 2.1 time: 0.222715 Dec 20 03:29:23.544481 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 84/155] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:23 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:23.681173 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d935c972-e3ed-482b-911c-6fe54605a554 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:23.681795 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d935c972-e3ed-482b-911c-6fe54605a554 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:23.691521 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-a34b62d6-5fce-4f2e-b4d7-c5e81c45392a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:23.692223 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d935c972-e3ed-482b-911c-6fe54605a554 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:23.692824 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d935c972-e3ed-482b-911c-6fe54605a554 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:23.694086 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d935c972-e3ed-482b-911c-6fe54605a554 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:23.694692 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d935c972-e3ed-482b-911c-6fe54605a554 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:23.706095 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a34b62d6-5fce-4f2e-b4d7-c5e81c45392a tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1314 microversion: 2.1 time: 0.297675 Dec 20 03:29:23.707107 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 72/156] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:23 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:23.917212 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-1423c56b-7c34-47e2-b6c4-8a058d708ded req-3f3c6c84-1e92-482f-b0cc-7efa6ead8939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ec437d6-633a-468c-aa6a-d4c81df62919", "name": "network-vif-plugged", "status": "completed", "tag": "8052eace-4c6b-4e95-b6b9-e785e74cfa8a"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:23.922285 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:29:23.922285 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:29:23.932862 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d935c972-e3ed-482b-911c-6fe54605a554 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:23.935220 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-1423c56b-7c34-47e2-b6c4-8a058d708ded req-3f3c6c84-1e92-482f-b0cc-7efa6ead8939 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:23.935833 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-1423c56b-7c34-47e2-b6c4-8a058d708ded req-3f3c6c84-1e92-482f-b0cc-7efa6ead8939 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:23.946187 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d935c972-e3ed-482b-911c-6fe54605a554 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1318 microversion: 2.1 time: 0.270399 Dec 20 03:29:23.947243 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 85/157] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:23 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:23.950217 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-1423c56b-7c34-47e2-b6c4-8a058d708ded req-3f3c6c84-1e92-482f-b0cc-7efa6ead8939 service nova] Creating event network-vif-plugged:8052eace-4c6b-4e95-b6b9-e785e74cfa8a for instance 5ec437d6-633a-468c-aa6a-d4c81df62919 on hv-cinder-81803 Dec 20 03:29:23.956546 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-1423c56b-7c34-47e2-b6c4-8a058d708ded req-3f3c6c84-1e92-482f-b0cc-7efa6ead8939 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053092 Dec 20 03:29:23.957539 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 73/158] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:29:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:29:24.561988 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-763dd760-ebce-4567-a07f-c0d29b046ac7 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:24.562823 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-763dd760-ebce-4567-a07f-c0d29b046ac7 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:24.570009 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-763dd760-ebce-4567-a07f-c0d29b046ac7 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:24.571296 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-763dd760-ebce-4567-a07f-c0d29b046ac7 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:24.572403 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-763dd760-ebce-4567-a07f-c0d29b046ac7 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:24.573070 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-763dd760-ebce-4567-a07f-c0d29b046ac7 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:24.725698 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-897d30b0-0c24-43f0-bf90-21746de54021 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:24.726803 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-897d30b0-0c24-43f0-bf90-21746de54021 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:24.741296 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-897d30b0-0c24-43f0-bf90-21746de54021 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:24.743191 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-897d30b0-0c24-43f0-bf90-21746de54021 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:24.746662 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-897d30b0-0c24-43f0-bf90-21746de54021 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:24.747348 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-897d30b0-0c24-43f0-bf90-21746de54021 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:24.941117 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-763dd760-ebce-4567-a07f-c0d29b046ac7 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:24.952038 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-763dd760-ebce-4567-a07f-c0d29b046ac7 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1363 microversion: 2.1 time: 0.393862 Dec 20 03:29:24.960264 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 86/159] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:24 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1363 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:24.974848 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-abbc4923-6a20-4586-abbb-27827d60300f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:24.976059 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-abbc4923-6a20-4586-abbb-27827d60300f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:24.988315 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-abbc4923-6a20-4586-abbb-27827d60300f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:24.990992 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-abbc4923-6a20-4586-abbb-27827d60300f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:24.992629 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-abbc4923-6a20-4586-abbb-27827d60300f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:24.993984 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-abbc4923-6a20-4586-abbb-27827d60300f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:25.047499 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-897d30b0-0c24-43f0-bf90-21746de54021 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:25.059145 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-897d30b0-0c24-43f0-bf90-21746de54021 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1314 microversion: 2.1 time: 0.338872 Dec 20 03:29:25.059811 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 74/160] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:24 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:25.197934 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-abbc4923-6a20-4586-abbb-27827d60300f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:25.224410 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-abbc4923-6a20-4586-abbb-27827d60300f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1508 microversion: 2.1 time: 0.255578 Dec 20 03:29:25.225479 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 87/161] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:24 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:25.971667 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-17f044f5-255d-4465-8998-3db38a79be39 req-e872ec67-59cd-4a57-af50-5e429f239c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "162a716d-d00f-4a5a-afc8-ff3f430a8e02", "name": "network-vif-plugged", "status": "completed", "tag": "62ed6e5b-3c1f-49fa-b6a4-bf7a8952539f"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:25.973307 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:29:25.973307 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:29:25.979657 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1df30d03-47ed-403b-9f01-d3af6c14baf1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:25.980342 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1df30d03-47ed-403b-9f01-d3af6c14baf1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:25.983419 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-17f044f5-255d-4465-8998-3db38a79be39 req-e872ec67-59cd-4a57-af50-5e429f239c84 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:25.984062 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-17f044f5-255d-4465-8998-3db38a79be39 req-e872ec67-59cd-4a57-af50-5e429f239c84 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:25.987080 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1df30d03-47ed-403b-9f01-d3af6c14baf1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:25.987543 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1df30d03-47ed-403b-9f01-d3af6c14baf1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:25.988351 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1df30d03-47ed-403b-9f01-d3af6c14baf1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:25.988878 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1df30d03-47ed-403b-9f01-d3af6c14baf1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:26.006219 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-17f044f5-255d-4465-8998-3db38a79be39 req-e872ec67-59cd-4a57-af50-5e429f239c84 service nova] Creating event network-vif-plugged:62ed6e5b-3c1f-49fa-b6a4-bf7a8952539f for instance 162a716d-d00f-4a5a-afc8-ff3f430a8e02 on hv-cinder-81803 Dec 20 03:29:26.013382 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-17f044f5-255d-4465-8998-3db38a79be39 req-e872ec67-59cd-4a57-af50-5e429f239c84 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043322 Dec 20 03:29:26.014396 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 88/162] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:29:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:29:26.085764 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-214ca326-0a5e-44d3-ad4b-05384fef2d5d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:26.088300 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-214ca326-0a5e-44d3-ad4b-05384fef2d5d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:26.119204 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-214ca326-0a5e-44d3-ad4b-05384fef2d5d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:26.120370 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-214ca326-0a5e-44d3-ad4b-05384fef2d5d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:26.125111 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-214ca326-0a5e-44d3-ad4b-05384fef2d5d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:26.126458 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-214ca326-0a5e-44d3-ad4b-05384fef2d5d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:26.230412 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1df30d03-47ed-403b-9f01-d3af6c14baf1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:26.238588 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1df30d03-47ed-403b-9f01-d3af6c14baf1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1363 microversion: 2.1 time: 0.271677 Dec 20 03:29:26.249532 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 75/163] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:25 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:26.356999 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-214ca326-0a5e-44d3-ad4b-05384fef2d5d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:26.368809 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-214ca326-0a5e-44d3-ad4b-05384fef2d5d tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1314 microversion: 2.1 time: 0.291092 Dec 20 03:29:26.369908 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 89/164] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:26 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:27.256410 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ada0c883-11b6-4913-91f2-9d7f070f8a9f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:27.257211 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ada0c883-11b6-4913-91f2-9d7f070f8a9f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:27.265312 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ada0c883-11b6-4913-91f2-9d7f070f8a9f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:27.265872 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ada0c883-11b6-4913-91f2-9d7f070f8a9f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:27.266773 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ada0c883-11b6-4913-91f2-9d7f070f8a9f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:27.267279 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ada0c883-11b6-4913-91f2-9d7f070f8a9f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:27.405900 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-8622fe3a-8439-4e6a-9dc1-53471fbba8a4 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:27.413227 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-8622fe3a-8439-4e6a-9dc1-53471fbba8a4 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:27.447999 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8622fe3a-8439-4e6a-9dc1-53471fbba8a4 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:27.448997 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8622fe3a-8439-4e6a-9dc1-53471fbba8a4 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:27.450110 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8622fe3a-8439-4e6a-9dc1-53471fbba8a4 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:27.450836 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8622fe3a-8439-4e6a-9dc1-53471fbba8a4 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:27.518579 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-ada0c883-11b6-4913-91f2-9d7f070f8a9f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:27.537865 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ada0c883-11b6-4913-91f2-9d7f070f8a9f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1549 microversion: 2.1 time: 0.284527 Dec 20 03:29:27.539512 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 76/165] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:27 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1549 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:27.558885 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-569c3113-e255-4b2d-8e5d-547fbc256344 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:27.559728 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-569c3113-e255-4b2d-8e5d-547fbc256344 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:27.573414 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-569c3113-e255-4b2d-8e5d-547fbc256344 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:27.574408 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-569c3113-e255-4b2d-8e5d-547fbc256344 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:27.576999 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-569c3113-e255-4b2d-8e5d-547fbc256344 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:27.577823 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-569c3113-e255-4b2d-8e5d-547fbc256344 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:27.768773 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-8622fe3a-8439-4e6a-9dc1-53471fbba8a4 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:27.787523 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-8622fe3a-8439-4e6a-9dc1-53471fbba8a4 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1314 microversion: 2.1 time: 0.386868 Dec 20 03:29:27.787523 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 90/166] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:27 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:27.822819 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-569c3113-e255-4b2d-8e5d-547fbc256344 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.269641 Dec 20 03:29:27.823492 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 77/167] 10.222.0.53 () {58 vars in 1274 bytes} [Mon Dec 20 03:29:27 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/os-interface => generated 284 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:29:28.802838 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-298cdf00-634a-472c-a8ec-81cba82674e1 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:28.805209 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-298cdf00-634a-472c-a8ec-81cba82674e1 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:28.836467 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-298cdf00-634a-472c-a8ec-81cba82674e1 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:28.839511 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-298cdf00-634a-472c-a8ec-81cba82674e1 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:28.848083 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-298cdf00-634a-472c-a8ec-81cba82674e1 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:28.849707 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-298cdf00-634a-472c-a8ec-81cba82674e1 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:29.132487 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-298cdf00-634a-472c-a8ec-81cba82674e1 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:29.140539 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-298cdf00-634a-472c-a8ec-81cba82674e1 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1314 microversion: 2.1 time: 0.344399 Dec 20 03:29:29.151119 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 91/168] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:28 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:30.039005 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-4e833e9c-b010-4adf-8291-876dc7b3f3b6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:30.039937 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-4e833e9c-b010-4adf-8291-876dc7b3f3b6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:30.040476 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-e8ee1fb5-1410-44fd-95c5-926106df75d3 req-9ba73ecc-5d9a-44f4-9cb4-186a18604885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ec437d6-633a-468c-aa6a-d4c81df62919", "tag": "8052eace-4c6b-4e95-b6b9-e785e74cfa8a"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:30.042209 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:29:30.042209 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:29:30.047282 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4e833e9c-b010-4adf-8291-876dc7b3f3b6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:30.048041 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4e833e9c-b010-4adf-8291-876dc7b3f3b6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:30.053296 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4e833e9c-b010-4adf-8291-876dc7b3f3b6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:30.053428 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-e8ee1fb5-1410-44fd-95c5-926106df75d3 req-9ba73ecc-5d9a-44f4-9cb4-186a18604885 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:30.053535 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4e833e9c-b010-4adf-8291-876dc7b3f3b6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:30.053640 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-e8ee1fb5-1410-44fd-95c5-926106df75d3 req-9ba73ecc-5d9a-44f4-9cb4-186a18604885 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:30.078127 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-e8ee1fb5-1410-44fd-95c5-926106df75d3 req-9ba73ecc-5d9a-44f4-9cb4-186a18604885 service nova] Creating event network-changed:8052eace-4c6b-4e95-b6b9-e785e74cfa8a for instance 5ec437d6-633a-468c-aa6a-d4c81df62919 on hv-cinder-81803 Dec 20 03:29:30.093404 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-e8ee1fb5-1410-44fd-95c5-926106df75d3 req-9ba73ecc-5d9a-44f4-9cb4-186a18604885 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052933 Dec 20 03:29:30.094811 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 92/169] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:29:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:29:30.159542 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-83bf839e-06e2-47fd-9f29-eca4ae4ab103 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:30.160447 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-83bf839e-06e2-47fd-9f29-eca4ae4ab103 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:30.168288 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-83bf839e-06e2-47fd-9f29-eca4ae4ab103 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:30.168739 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-83bf839e-06e2-47fd-9f29-eca4ae4ab103 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:30.169791 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-83bf839e-06e2-47fd-9f29-eca4ae4ab103 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:30.170269 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-83bf839e-06e2-47fd-9f29-eca4ae4ab103 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:30.381342 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-83bf839e-06e2-47fd-9f29-eca4ae4ab103 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:30.389881 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-83bf839e-06e2-47fd-9f29-eca4ae4ab103 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1314 microversion: 2.1 time: 0.234619 Dec 20 03:29:30.390740 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 93/170] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:30 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:31.420707 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-56bf80ad-3134-4851-8908-24bcce868029 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:31.422036 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-56bf80ad-3134-4851-8908-24bcce868029 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:31.434582 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-56bf80ad-3134-4851-8908-24bcce868029 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:31.440150 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-56bf80ad-3134-4851-8908-24bcce868029 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:31.440150 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-56bf80ad-3134-4851-8908-24bcce868029 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:31.440150 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-56bf80ad-3134-4851-8908-24bcce868029 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:31.633374 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-56bf80ad-3134-4851-8908-24bcce868029 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:31.648302 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-56bf80ad-3134-4851-8908-24bcce868029 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1314 microversion: 2.1 time: 0.234403 Dec 20 03:29:31.649935 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 94/171] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:31 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:32.669821 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-66fad235-7140-4f11-9877-52d683ef0f2f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:32.670513 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-66fad235-7140-4f11-9877-52d683ef0f2f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:32.677300 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-66fad235-7140-4f11-9877-52d683ef0f2f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:32.677850 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-66fad235-7140-4f11-9877-52d683ef0f2f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:32.678681 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-66fad235-7140-4f11-9877-52d683ef0f2f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:32.679151 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-66fad235-7140-4f11-9877-52d683ef0f2f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:32.813325 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-4e833e9c-b010-4adf-8291-876dc7b3f3b6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 14 microversion: 2.1 time: 2.778069 Dec 20 03:29:32.813969 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 78/172] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:29:30 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 14 bytes in 2780 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 03:29:32.865718 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-66fad235-7140-4f11-9877-52d683ef0f2f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:32.877924 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-66fad235-7140-4f11-9877-52d683ef0f2f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1314 microversion: 2.1 time: 0.211757 Dec 20 03:29:32.878536 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 95/173] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:32 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:33.348937 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-bdde0a6d-0775-47a1-84f3-2611da63f26a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18a9cc8c-e299-4917-b96d-8d3bdaa7acd2"}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:33.351614 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-bdde0a6d-0775-47a1-84f3-2611da63f26a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:33.360342 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bdde0a6d-0775-47a1-84f3-2611da63f26a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:33.361003 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bdde0a6d-0775-47a1-84f3-2611da63f26a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:33.361955 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bdde0a6d-0775-47a1-84f3-2611da63f26a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:33.362401 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bdde0a6d-0775-47a1-84f3-2611da63f26a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:33.828011 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-edc5761e-7802-4af7-9234-458baba4fab0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:33.829011 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-edc5761e-7802-4af7-9234-458baba4fab0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:33.835692 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-edc5761e-7802-4af7-9234-458baba4fab0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:33.836146 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-edc5761e-7802-4af7-9234-458baba4fab0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:33.836947 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-edc5761e-7802-4af7-9234-458baba4fab0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:33.837422 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-edc5761e-7802-4af7-9234-458baba4fab0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:33.991742 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-edc5761e-7802-4af7-9234-458baba4fab0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 14 microversion: 2.1 time: 0.168547 Dec 20 03:29:33.992507 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 96/174] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:29:33 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 20 03:29:33.998010 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-6f4045b8-15e2-40aa-a45b-7d283c2840fe tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:33.998745 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6f4045b8-15e2-40aa-a45b-7d283c2840fe tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:34.006850 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6f4045b8-15e2-40aa-a45b-7d283c2840fe tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:34.011873 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6f4045b8-15e2-40aa-a45b-7d283c2840fe tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:34.011873 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6f4045b8-15e2-40aa-a45b-7d283c2840fe tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:34.011873 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6f4045b8-15e2-40aa-a45b-7d283c2840fe tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:34.187746 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6f4045b8-15e2-40aa-a45b-7d283c2840fe tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:34.202633 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-6f4045b8-15e2-40aa-a45b-7d283c2840fe tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1500 microversion: 2.1 time: 0.208931 Dec 20 03:29:34.203657 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 97/175] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:33 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1500 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:34.951189 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-bdde0a6d-0775-47a1-84f3-2611da63f26a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "POST /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.607667 Dec 20 03:29:34.957713 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 79/176] 10.222.0.53 () {60 vars in 1322 bytes} [Mon Dec 20 03:29:33 2021] POST /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17/os-volume_attachments => generated 194 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:29:35.007800 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-315a87f3-d956-4069-abf5-c98b95c8b7a7 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:35.008943 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-315a87f3-d956-4069-abf5-c98b95c8b7a7 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:35.015983 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-315a87f3-d956-4069-abf5-c98b95c8b7a7 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:35.016710 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-315a87f3-d956-4069-abf5-c98b95c8b7a7 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:35.017695 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-315a87f3-d956-4069-abf5-c98b95c8b7a7 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:35.018140 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-315a87f3-d956-4069-abf5-c98b95c8b7a7 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:35.107649 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-315a87f3-d956-4069-abf5-c98b95c8b7a7 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 14 microversion: 2.1 time: 0.106984 Dec 20 03:29:35.108952 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 98/177] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:29:34 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 03:29:36.120842 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-59131434-657a-4acc-ab4e-4f7d52110915 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:36.122508 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-59131434-657a-4acc-ab4e-4f7d52110915 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:36.128739 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-59131434-657a-4acc-ab4e-4f7d52110915 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:36.131616 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-59131434-657a-4acc-ab4e-4f7d52110915 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:36.131616 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-59131434-657a-4acc-ab4e-4f7d52110915 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:36.131616 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-59131434-657a-4acc-ab4e-4f7d52110915 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:36.241889 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-59131434-657a-4acc-ab4e-4f7d52110915 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 14 microversion: 2.1 time: 0.125487 Dec 20 03:29:36.246149 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 80/178] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:29:36 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 03:29:37.267050 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-5c7eda6d-45c4-4330-b9c6-fe6deaff0149 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:37.268842 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-5c7eda6d-45c4-4330-b9c6-fe6deaff0149 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:37.280992 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5c7eda6d-45c4-4330-b9c6-fe6deaff0149 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:37.281738 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5c7eda6d-45c4-4330-b9c6-fe6deaff0149 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:37.283142 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5c7eda6d-45c4-4330-b9c6-fe6deaff0149 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:37.284155 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5c7eda6d-45c4-4330-b9c6-fe6deaff0149 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:37.431003 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-5c7eda6d-45c4-4330-b9c6-fe6deaff0149 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 14 microversion: 2.1 time: 0.172332 Dec 20 03:29:37.432212 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 99/179] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:29:37 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 03:29:37.476009 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-af58da7e-b474-4f40-81ef-d52822e2dbd7 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a799aba-96da-4e72-9017-8c0c3110783d"}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:37.479534 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-af58da7e-b474-4f40-81ef-d52822e2dbd7 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:37.495956 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-af58da7e-b474-4f40-81ef-d52822e2dbd7 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:37.497295 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-af58da7e-b474-4f40-81ef-d52822e2dbd7 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:37.499296 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-af58da7e-b474-4f40-81ef-d52822e2dbd7 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:37.500393 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-af58da7e-b474-4f40-81ef-d52822e2dbd7 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:38.454328 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f6411551-69b1-4b75-9cbd-96860c816a0f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:38.456434 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-f6411551-69b1-4b75-9cbd-96860c816a0f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:38.466553 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f6411551-69b1-4b75-9cbd-96860c816a0f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:38.467374 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f6411551-69b1-4b75-9cbd-96860c816a0f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:38.470895 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f6411551-69b1-4b75-9cbd-96860c816a0f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:38.471615 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f6411551-69b1-4b75-9cbd-96860c816a0f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:38.601571 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f6411551-69b1-4b75-9cbd-96860c816a0f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 14 microversion: 2.1 time: 0.160561 Dec 20 03:29:38.603539 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 100/180] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:29:38 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 03:29:39.201650 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-af58da7e-b474-4f40-81ef-d52822e2dbd7 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "POST /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.734466 Dec 20 03:29:39.202713 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 81/181] 10.222.0.53 () {60 vars in 1322 bytes} [Mon Dec 20 03:29:37 2021] POST /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02/os-volume_attachments => generated 194 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:29:39.620624 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0ce8a1f2-ba3f-42c3-8f8c-d478c47576d0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:39.622741 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-0ce8a1f2-ba3f-42c3-8f8c-d478c47576d0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:39.630701 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0ce8a1f2-ba3f-42c3-8f8c-d478c47576d0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:39.631268 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0ce8a1f2-ba3f-42c3-8f8c-d478c47576d0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:39.636216 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0ce8a1f2-ba3f-42c3-8f8c-d478c47576d0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:39.636216 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0ce8a1f2-ba3f-42c3-8f8c-d478c47576d0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:39.786706 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-0ce8a1f2-ba3f-42c3-8f8c-d478c47576d0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 5760 microversion: 2.1 time: 0.170900 Dec 20 03:29:39.787617 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 101/182] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:29:39 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 5760 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:40.816168 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f3622b28-78a8-4c92-8b23-19524e9cd818 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:40.819398 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f3622b28-78a8-4c92-8b23-19524e9cd818 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:40.836142 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f3622b28-78a8-4c92-8b23-19524e9cd818 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:40.837392 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f3622b28-78a8-4c92-8b23-19524e9cd818 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:40.839363 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f3622b28-78a8-4c92-8b23-19524e9cd818 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:40.840623 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f3622b28-78a8-4c92-8b23-19524e9cd818 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:40.970799 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f3622b28-78a8-4c92-8b23-19524e9cd818 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 11454 microversion: 2.1 time: 0.173140 Dec 20 03:29:40.975869 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 82/183] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:29:40 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 11454 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:29:41.983749 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a5c39322-cf75-4824-80e5-4e598d75a9ea tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:41.984754 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a5c39322-cf75-4824-80e5-4e598d75a9ea tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:41.992562 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a5c39322-cf75-4824-80e5-4e598d75a9ea tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:41.993010 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a5c39322-cf75-4824-80e5-4e598d75a9ea tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:41.994102 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a5c39322-cf75-4824-80e5-4e598d75a9ea tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:41.994564 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a5c39322-cf75-4824-80e5-4e598d75a9ea tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:42.091217 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a5c39322-cf75-4824-80e5-4e598d75a9ea tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 16319 microversion: 2.1 time: 0.111444 Dec 20 03:29:42.096957 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 102/184] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:29:41 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 16319 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:29:43.103647 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-623fd031-9662-400a-bd76-98364217c5a2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:43.105518 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-623fd031-9662-400a-bd76-98364217c5a2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:43.117411 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-623fd031-9662-400a-bd76-98364217c5a2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:43.117411 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-623fd031-9662-400a-bd76-98364217c5a2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:43.117411 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-623fd031-9662-400a-bd76-98364217c5a2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:43.117411 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-623fd031-9662-400a-bd76-98364217c5a2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:43.229615 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-623fd031-9662-400a-bd76-98364217c5a2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 18449 microversion: 2.1 time: 0.129797 Dec 20 03:29:43.230425 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 83/185] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:29:43 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 18449 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:29:44.245071 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-9de57e3b-a6dd-4b9d-9bf0-0284d7a460b1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:44.246148 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-9de57e3b-a6dd-4b9d-9bf0-0284d7a460b1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:44.253803 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9de57e3b-a6dd-4b9d-9bf0-0284d7a460b1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:44.255223 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9de57e3b-a6dd-4b9d-9bf0-0284d7a460b1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:44.256272 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9de57e3b-a6dd-4b9d-9bf0-0284d7a460b1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:44.256811 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9de57e3b-a6dd-4b9d-9bf0-0284d7a460b1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:44.387548 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-9de57e3b-a6dd-4b9d-9bf0-0284d7a460b1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 20018 microversion: 2.1 time: 0.145665 Dec 20 03:29:44.388516 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 103/186] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:29:44 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 20018 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:29:45.403267 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-846f521b-1230-4a6e-b454-14f15f19d222 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:45.404263 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-846f521b-1230-4a6e-b454-14f15f19d222 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:45.411575 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-846f521b-1230-4a6e-b454-14f15f19d222 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:45.412099 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-846f521b-1230-4a6e-b454-14f15f19d222 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:45.413001 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-846f521b-1230-4a6e-b454-14f15f19d222 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:45.413532 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-846f521b-1230-4a6e-b454-14f15f19d222 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:45.662282 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-846f521b-1230-4a6e-b454-14f15f19d222 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 22210 microversion: 2.1 time: 0.147371 Dec 20 03:29:45.662282 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 84/187] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:29:45 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 22210 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:29:46.677570 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a1c0a0e4-831d-40dc-857d-9b65fd817497 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:46.679214 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a1c0a0e4-831d-40dc-857d-9b65fd817497 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:46.692928 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a1c0a0e4-831d-40dc-857d-9b65fd817497 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:46.695810 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a1c0a0e4-831d-40dc-857d-9b65fd817497 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:46.695810 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a1c0a0e4-831d-40dc-857d-9b65fd817497 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:46.696289 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a1c0a0e4-831d-40dc-857d-9b65fd817497 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:46.838629 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-6039d3a2-63d7-403c-8e9f-4603e0d20249 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1800238194", "imageRef": "9c4ec443-915b-4997-82d3-08cc97ba635b", "flavorRef": "452", "networks": [{"uuid": "81fcedcc-7077-48be-86e2-d027fe8cf5ab"}]}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:46.839638 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a1c0a0e4-831d-40dc-857d-9b65fd817497 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 23795 microversion: 2.1 time: 0.161392 Dec 20 03:29:46.839638 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 104/188] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:29:46 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 23795 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:29:46.839825 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.network.neutron [None req-6039d3a2-63d7-403c-8e9f-4603e0d20249 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] validate_networks() for [('81fcedcc-7077-48be-86e2-d027fe8cf5ab', None, None, None, None, None)] {{(pid=117012) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:29:47.320374 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-6039d3a2-63d7-403c-8e9f-4603e0d20249 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Flavor limits 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:29:47.322120 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-6039d3a2-63d7-403c-8e9f-4603e0d20249 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Image limits 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:29:47.324373 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-6039d3a2-63d7-403c-8e9f-4603e0d20249 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Flavor pref 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:29:47.326325 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-6039d3a2-63d7-403c-8e9f-4603e0d20249 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Image pref 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:29:47.327424 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-6039d3a2-63d7-403c-8e9f-4603e0d20249 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:29:47.350848 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6039d3a2-63d7-403c-8e9f-4603e0d20249 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:47.352780 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6039d3a2-63d7-403c-8e9f-4603e0d20249 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:47.356103 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6039d3a2-63d7-403c-8e9f-4603e0d20249 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:47.357360 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6039d3a2-63d7-403c-8e9f-4603e0d20249 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:47.408456 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-6039d3a2-63d7-403c-8e9f-4603e0d20249 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Getting quotas for project 032e3b59ca34420bbb5bdcaaa1cbb72b. Resources: {'instances', 'ram', 'cores'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:29:47.418890 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-6039d3a2-63d7-403c-8e9f-4603e0d20249 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Getting quotas for user b9dcbac34c544fdea6152f710ab3d521 and project 032e3b59ca34420bbb5bdcaaa1cbb72b. Resources: {'instances', 'ram', 'cores'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:29:47.435033 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6039d3a2-63d7-403c-8e9f-4603e0d20249 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Going to run 1 instances... {{(pid=117012) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:29:47.438616 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6039d3a2-63d7-403c-8e9f-4603e0d20249 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c4ec443-915b-4997-82d3-08cc97ba635b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117012) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:29:47.698193 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-6039d3a2-63d7-403c-8e9f-4603e0d20249 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.933410 Dec 20 03:29:47.699166 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 85/189] 10.222.0.53 () {60 vars in 1146 bytes} [Mon Dec 20 03:29:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 03:29:47.718938 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-3ef87f18-a5c4-4c22-b03b-3b948146f3d3 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:47.721996 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-3ef87f18-a5c4-4c22-b03b-3b948146f3d3 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:47.798639 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-3ef87f18-a5c4-4c22-b03b-3b948146f3d3 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:47.806523 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-3ef87f18-a5c4-4c22-b03b-3b948146f3d3 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1218 microversion: 2.1 time: 0.095976 Dec 20 03:29:47.807895 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 105/190] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:47 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:47.846748 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a07a2bc2-22a2-4a73-8fad-fa8caf463919 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:47.849080 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a07a2bc2-22a2-4a73-8fad-fa8caf463919 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:47.858362 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a07a2bc2-22a2-4a73-8fad-fa8caf463919 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:47.859092 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a07a2bc2-22a2-4a73-8fad-fa8caf463919 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:47.860146 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a07a2bc2-22a2-4a73-8fad-fa8caf463919 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:47.861012 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a07a2bc2-22a2-4a73-8fad-fa8caf463919 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:48.824124 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-09169a2d-c57c-4482-8644-b366404a5889 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:48.824667 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-09169a2d-c57c-4482-8644-b366404a5889 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:48.831434 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-09169a2d-c57c-4482-8644-b366404a5889 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:48.831902 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-09169a2d-c57c-4482-8644-b366404a5889 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:48.832696 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-09169a2d-c57c-4482-8644-b366404a5889 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:48.833161 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-09169a2d-c57c-4482-8644-b366404a5889 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:48.903187 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-09169a2d-c57c-4482-8644-b366404a5889 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:48.911471 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-09169a2d-c57c-4482-8644-b366404a5889 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1222 microversion: 2.1 time: 0.091162 Dec 20 03:29:48.912049 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 106/191] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:48 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:49.937334 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d43a2fcb-6750-41f6-af5c-72b787f8b887 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:49.938437 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d43a2fcb-6750-41f6-af5c-72b787f8b887 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:49.950195 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d43a2fcb-6750-41f6-af5c-72b787f8b887 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:49.950776 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d43a2fcb-6750-41f6-af5c-72b787f8b887 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:49.951715 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d43a2fcb-6750-41f6-af5c-72b787f8b887 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:49.952276 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d43a2fcb-6750-41f6-af5c-72b787f8b887 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:50.027111 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d43a2fcb-6750-41f6-af5c-72b787f8b887 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:50.036539 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d43a2fcb-6750-41f6-af5c-72b787f8b887 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1222 microversion: 2.1 time: 0.105560 Dec 20 03:29:50.037483 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 107/192] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:49 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:50.835441 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a07a2bc2-22a2-4a73-8fad-fa8caf463919 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 26693 microversion: 2.1 time: 2.992858 Dec 20 03:29:50.841091 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 86/193] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:29:47 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 26693 bytes in 2996 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:29:51.056996 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-13603895-c82f-4159-82d0-b571c088c687 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:51.061691 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-13603895-c82f-4159-82d0-b571c088c687 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:51.067767 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-13603895-c82f-4159-82d0-b571c088c687 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:51.068420 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-13603895-c82f-4159-82d0-b571c088c687 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:51.069622 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-13603895-c82f-4159-82d0-b571c088c687 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:51.070124 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-13603895-c82f-4159-82d0-b571c088c687 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:51.158454 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-13603895-c82f-4159-82d0-b571c088c687 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:51.166794 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-13603895-c82f-4159-82d0-b571c088c687 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1222 microversion: 2.1 time: 0.114049 Dec 20 03:29:51.173420 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 108/194] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:51 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1222 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:51.855561 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-02e01dc0-4f53-41e8-bf6a-7e9edfaebe58 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:51.856781 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-02e01dc0-4f53-41e8-bf6a-7e9edfaebe58 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:51.865329 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-02e01dc0-4f53-41e8-bf6a-7e9edfaebe58 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:51.865795 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-02e01dc0-4f53-41e8-bf6a-7e9edfaebe58 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:51.866642 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-02e01dc0-4f53-41e8-bf6a-7e9edfaebe58 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:51.867088 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-02e01dc0-4f53-41e8-bf6a-7e9edfaebe58 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:52.198288 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ee91e086-ff50-4055-b428-c52c8b70b20f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:52.198288 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ee91e086-ff50-4055-b428-c52c8b70b20f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:52.208947 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ee91e086-ff50-4055-b428-c52c8b70b20f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:52.209857 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ee91e086-ff50-4055-b428-c52c8b70b20f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:52.211517 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ee91e086-ff50-4055-b428-c52c8b70b20f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:52.212356 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ee91e086-ff50-4055-b428-c52c8b70b20f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:52.303706 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ee91e086-ff50-4055-b428-c52c8b70b20f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:52.313670 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ee91e086-ff50-4055-b428-c52c8b70b20f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1270 microversion: 2.1 time: 0.124124 Dec 20 03:29:52.313670 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 109/195] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:52 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1270 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:53.331398 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-5e854a34-4b8d-486a-8813-61989e06b815 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:53.333034 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-5e854a34-4b8d-486a-8813-61989e06b815 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:53.343409 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5e854a34-4b8d-486a-8813-61989e06b815 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:53.343870 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5e854a34-4b8d-486a-8813-61989e06b815 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:53.345193 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5e854a34-4b8d-486a-8813-61989e06b815 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:53.345923 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5e854a34-4b8d-486a-8813-61989e06b815 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:53.428175 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-5e854a34-4b8d-486a-8813-61989e06b815 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:53.437872 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-5e854a34-4b8d-486a-8813-61989e06b815 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1270 microversion: 2.1 time: 0.111618 Dec 20 03:29:53.438501 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 110/196] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:53 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:54.162861 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-02e01dc0-4f53-41e8-bf6a-7e9edfaebe58 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 27789 microversion: 2.1 time: 2.311417 Dec 20 03:29:54.170006 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 87/197] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:29:51 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 27789 bytes in 2315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:29:54.454829 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-02d99e00-3fad-4f49-a406-4f6f22def524 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:54.455648 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-02d99e00-3fad-4f49-a406-4f6f22def524 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:54.463478 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-02d99e00-3fad-4f49-a406-4f6f22def524 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:54.469356 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-02d99e00-3fad-4f49-a406-4f6f22def524 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:54.469356 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-02d99e00-3fad-4f49-a406-4f6f22def524 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:54.469356 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-02d99e00-3fad-4f49-a406-4f6f22def524 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:54.528666 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-02d99e00-3fad-4f49-a406-4f6f22def524 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:54.537492 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-02d99e00-3fad-4f49-a406-4f6f22def524 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1270 microversion: 2.1 time: 0.086319 Dec 20 03:29:54.538076 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 111/198] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:54 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:55.180323 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-44ce1d67-9896-4e8a-a2e3-33239501cb91 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:55.181727 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-44ce1d67-9896-4e8a-a2e3-33239501cb91 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:55.201560 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-44ce1d67-9896-4e8a-a2e3-33239501cb91 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:55.202305 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-44ce1d67-9896-4e8a-a2e3-33239501cb91 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:55.203607 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-44ce1d67-9896-4e8a-a2e3-33239501cb91 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:55.204132 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-44ce1d67-9896-4e8a-a2e3-33239501cb91 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:55.334434 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-44ce1d67-9896-4e8a-a2e3-33239501cb91 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 28150 microversion: 2.1 time: 0.159027 Dec 20 03:29:55.346321 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 88/199] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:29:55 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 28150 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:29:55.556065 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f020eba1-b6ce-4392-a259-0ed859913aae tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:55.556660 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-f020eba1-b6ce-4392-a259-0ed859913aae tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:55.564071 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f020eba1-b6ce-4392-a259-0ed859913aae tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:55.564728 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f020eba1-b6ce-4392-a259-0ed859913aae tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:55.565720 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f020eba1-b6ce-4392-a259-0ed859913aae tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:55.568523 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f020eba1-b6ce-4392-a259-0ed859913aae tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:55.697877 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-f020eba1-b6ce-4392-a259-0ed859913aae tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:55.723129 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f020eba1-b6ce-4392-a259-0ed859913aae tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1276 microversion: 2.1 time: 0.171600 Dec 20 03:29:55.724167 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 112/200] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:55 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:56.352064 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f7d3f5a7-8e12-42dc-ad70-32dfbabae391 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:56.353830 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f7d3f5a7-8e12-42dc-ad70-32dfbabae391 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:56.362647 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f7d3f5a7-8e12-42dc-ad70-32dfbabae391 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:56.368806 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f7d3f5a7-8e12-42dc-ad70-32dfbabae391 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:56.368806 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f7d3f5a7-8e12-42dc-ad70-32dfbabae391 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:56.368806 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f7d3f5a7-8e12-42dc-ad70-32dfbabae391 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:56.474260 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f7d3f5a7-8e12-42dc-ad70-32dfbabae391 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 28150 microversion: 2.1 time: 0.125504 Dec 20 03:29:56.476194 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 89/201] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:29:56 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 28150 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:29:56.759509 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-62049ca3-ad89-400c-a263-3a42e0292703 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:56.760664 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-62049ca3-ad89-400c-a263-3a42e0292703 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:56.767736 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-62049ca3-ad89-400c-a263-3a42e0292703 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:56.769386 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-62049ca3-ad89-400c-a263-3a42e0292703 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:56.769566 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-62049ca3-ad89-400c-a263-3a42e0292703 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:56.770392 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-62049ca3-ad89-400c-a263-3a42e0292703 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:56.818704 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-6678e254-231d-498e-afb4-30af685b360f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:56.819944 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6678e254-231d-498e-afb4-30af685b360f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:56.833935 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6678e254-231d-498e-afb4-30af685b360f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:56.834409 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6678e254-231d-498e-afb4-30af685b360f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:56.842581 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6678e254-231d-498e-afb4-30af685b360f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:56.843072 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6678e254-231d-498e-afb4-30af685b360f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:56.885429 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6678e254-231d-498e-afb4-30af685b360f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Going to try to terminate instance {{(pid=117012) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:29:57.090405 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-62049ca3-ad89-400c-a263-3a42e0292703 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:57.099357 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-62049ca3-ad89-400c-a263-3a42e0292703 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1318 microversion: 2.1 time: 0.346219 Dec 20 03:29:57.100288 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 113/202] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:56 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:57.369329 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-6678e254-231d-498e-afb4-30af685b360f tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "DELETE /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 204 len: 0 microversion: 2.1 time: 0.554958 Dec 20 03:29:57.370428 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 90/203] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:29:56 2021] DELETE /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 20 03:29:57.381173 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-c14cf65b-f482-4495-ac63-23273576bd32 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:57.382057 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-c14cf65b-f482-4495-ac63-23273576bd32 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:57.389791 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c14cf65b-f482-4495-ac63-23273576bd32 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:57.390494 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c14cf65b-f482-4495-ac63-23273576bd32 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:57.391923 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c14cf65b-f482-4495-ac63-23273576bd32 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:57.392413 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c14cf65b-f482-4495-ac63-23273576bd32 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:57.500693 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d0ae2fd7-b8ea-4b34-b879-785403bb29ed tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:57.502499 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d0ae2fd7-b8ea-4b34-b879-785403bb29ed tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:57.514011 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d0ae2fd7-b8ea-4b34-b879-785403bb29ed tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:57.514785 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d0ae2fd7-b8ea-4b34-b879-785403bb29ed tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:57.517388 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d0ae2fd7-b8ea-4b34-b879-785403bb29ed tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:57.518198 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d0ae2fd7-b8ea-4b34-b879-785403bb29ed tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:57.666574 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-c14cf65b-f482-4495-ac63-23273576bd32 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:57.675761 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-c14cf65b-f482-4495-ac63-23273576bd32 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1552 microversion: 2.1 time: 0.299830 Dec 20 03:29:57.676483 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 114/204] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:57 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1552 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:29:57.681188 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-51804f25-9c35-49cd-856d-0341935a69b6 req-81024e04-32fb-4c03-992f-7fe89561bac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "193a15ec-d618-4edf-967c-09b3ccc4069e", "tag": "27cdf226-e684-4867-9d0a-236f8a22a8f4"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:57.682732 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:29:57.682732 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:29:57.690419 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-51804f25-9c35-49cd-856d-0341935a69b6 req-81024e04-32fb-4c03-992f-7fe89561bac8 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:57.690921 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-51804f25-9c35-49cd-856d-0341935a69b6 req-81024e04-32fb-4c03-992f-7fe89561bac8 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:57.696137 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d0ae2fd7-b8ea-4b34-b879-785403bb29ed tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 28358 microversion: 2.1 time: 0.203220 Dec 20 03:29:57.701169 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 91/205] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:29:57 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 28358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:29:57.703565 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-51804f25-9c35-49cd-856d-0341935a69b6 req-81024e04-32fb-4c03-992f-7fe89561bac8 service nova] Creating event network-changed:27cdf226-e684-4867-9d0a-236f8a22a8f4 for instance 193a15ec-d618-4edf-967c-09b3ccc4069e on hv-cinder-81803 Dec 20 03:29:57.710056 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-51804f25-9c35-49cd-856d-0341935a69b6 req-81024e04-32fb-4c03-992f-7fe89561bac8 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031792 Dec 20 03:29:57.711373 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 115/206] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:29:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:29:58.117287 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c112d8c6-5db1-4a08-bae2-dac44e61759b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:58.117945 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c112d8c6-5db1-4a08-bae2-dac44e61759b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:58.125863 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c112d8c6-5db1-4a08-bae2-dac44e61759b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:58.126312 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c112d8c6-5db1-4a08-bae2-dac44e61759b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:58.127116 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c112d8c6-5db1-4a08-bae2-dac44e61759b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:58.127548 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c112d8c6-5db1-4a08-bae2-dac44e61759b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:58.356156 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c112d8c6-5db1-4a08-bae2-dac44e61759b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:58.365970 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c112d8c6-5db1-4a08-bae2-dac44e61759b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1318 microversion: 2.1 time: 0.253027 Dec 20 03:29:58.366818 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 92/207] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:58 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:58.695227 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-71b0b3ef-5441-45f5-b87c-f674dd5d3575 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:58.695918 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-71b0b3ef-5441-45f5-b87c-f674dd5d3575 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:58.703823 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-71b0b3ef-5441-45f5-b87c-f674dd5d3575 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:58.704266 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-71b0b3ef-5441-45f5-b87c-f674dd5d3575 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:58.705062 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-71b0b3ef-5441-45f5-b87c-f674dd5d3575 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:58.705538 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-71b0b3ef-5441-45f5-b87c-f674dd5d3575 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:58.711765 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1102b83f-bc7c-4703-8ac3-52e9a9f6271f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:58.713418 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1102b83f-bc7c-4703-8ac3-52e9a9f6271f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:58.720608 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1102b83f-bc7c-4703-8ac3-52e9a9f6271f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:58.721548 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1102b83f-bc7c-4703-8ac3-52e9a9f6271f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:58.731046 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1102b83f-bc7c-4703-8ac3-52e9a9f6271f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:58.731046 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1102b83f-bc7c-4703-8ac3-52e9a9f6271f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:58.874293 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1102b83f-bc7c-4703-8ac3-52e9a9f6271f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 28438 microversion: 2.1 time: 0.169296 Dec 20 03:29:58.874921 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 93/208] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:29:58 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 28438 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:29:58.947630 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-71b0b3ef-5441-45f5-b87c-f674dd5d3575 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:58.956458 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-71b0b3ef-5441-45f5-b87c-f674dd5d3575 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1552 microversion: 2.1 time: 0.265671 Dec 20 03:29:58.957909 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 116/209] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:58 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1552 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:59.393935 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-28bbbc81-7a27-4115-b2ba-47a12f7fa9de tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:59.395461 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-28bbbc81-7a27-4115-b2ba-47a12f7fa9de tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:59.409453 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-28bbbc81-7a27-4115-b2ba-47a12f7fa9de tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:59.409453 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-28bbbc81-7a27-4115-b2ba-47a12f7fa9de tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:59.409453 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-28bbbc81-7a27-4115-b2ba-47a12f7fa9de tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:59.409453 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-28bbbc81-7a27-4115-b2ba-47a12f7fa9de tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:59.832957 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-28bbbc81-7a27-4115-b2ba-47a12f7fa9de tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:29:59.847038 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-28bbbc81-7a27-4115-b2ba-47a12f7fa9de tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1318 microversion: 2.1 time: 0.456781 Dec 20 03:29:59.848398 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 94/210] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:59 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:29:59.886828 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-cd7c0ae5-d66b-44b7-9aa1-a12aad1e5338 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:29:59.887793 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-cd7c0ae5-d66b-44b7-9aa1-a12aad1e5338 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:59.894535 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-cd7c0ae5-d66b-44b7-9aa1-a12aad1e5338 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:59.895891 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-cd7c0ae5-d66b-44b7-9aa1-a12aad1e5338 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:59.896714 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-cd7c0ae5-d66b-44b7-9aa1-a12aad1e5338 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:59.897169 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-cd7c0ae5-d66b-44b7-9aa1-a12aad1e5338 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:59.975927 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-49d9a231-5be0-4648-ad1b-3e075620d610 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:29:59.976838 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-49d9a231-5be0-4648-ad1b-3e075620d610 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:29:59.983795 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-49d9a231-5be0-4648-ad1b-3e075620d610 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:59.984556 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-49d9a231-5be0-4648-ad1b-3e075620d610 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:29:59.985386 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-49d9a231-5be0-4648-ad1b-3e075620d610 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:29:59.985821 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-49d9a231-5be0-4648-ad1b-3e075620d610 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:00.026555 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-cd7c0ae5-d66b-44b7-9aa1-a12aad1e5338 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 28605 microversion: 2.1 time: 0.143343 Dec 20 03:30:00.027632 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 117/211] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:29:59 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 28605 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:30:00.150942 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-49d9a231-5be0-4648-ad1b-3e075620d610 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:00.167635 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-49d9a231-5be0-4648-ad1b-3e075620d610 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1552 microversion: 2.1 time: 0.195669 Dec 20 03:30:00.169253 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 95/212] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:29:59 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1552 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:30:00.877500 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-bd53f13c-46b2-44b5-924a-6927789ac023 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:00.878685 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-bd53f13c-46b2-44b5-924a-6927789ac023 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:00.895052 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bd53f13c-46b2-44b5-924a-6927789ac023 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:00.896059 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bd53f13c-46b2-44b5-924a-6927789ac023 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:00.898022 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bd53f13c-46b2-44b5-924a-6927789ac023 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:00.898630 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bd53f13c-46b2-44b5-924a-6927789ac023 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:01.043398 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-537d0679-d59c-493a-9d5a-cf966be0bc48 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:01.046629 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-537d0679-d59c-493a-9d5a-cf966be0bc48 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:01.064421 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-537d0679-d59c-493a-9d5a-cf966be0bc48 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:01.065925 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-537d0679-d59c-493a-9d5a-cf966be0bc48 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:01.067784 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-537d0679-d59c-493a-9d5a-cf966be0bc48 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:01.068907 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-537d0679-d59c-493a-9d5a-cf966be0bc48 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:01.193979 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-537d0679-d59c-493a-9d5a-cf966be0bc48 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 28605 microversion: 2.1 time: 0.157350 Dec 20 03:30:01.196231 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 96/213] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:30:01 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 28605 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:30:01.201612 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-45e3d189-93f1-4ee8-be83-b64d4442a2d9 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:01.202584 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-45e3d189-93f1-4ee8-be83-b64d4442a2d9 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:01.209906 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-45e3d189-93f1-4ee8-be83-b64d4442a2d9 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:01.210360 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-45e3d189-93f1-4ee8-be83-b64d4442a2d9 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:01.211353 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-45e3d189-93f1-4ee8-be83-b64d4442a2d9 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:01.212569 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-45e3d189-93f1-4ee8-be83-b64d4442a2d9 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:01.296912 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-45e3d189-93f1-4ee8-be83-b64d4442a2d9 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:01.304919 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-bd53f13c-46b2-44b5-924a-6927789ac023 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:01.314257 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-bd53f13c-46b2-44b5-924a-6927789ac023 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1318 microversion: 2.1 time: 0.442511 Dec 20 03:30:01.315255 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 118/214] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:00 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:30:01.318589 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-45e3d189-93f1-4ee8-be83-b64d4442a2d9 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1510 microversion: 2.1 time: 0.120902 Dec 20 03:30:01.319535 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 97/215] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:01 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1510 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:01.323623 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-d54048d0-fe1e-4b31-80a2-8451636b8094 req-1c24faf1-fc0f-41a2-88f7-5675eecf6550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "162a716d-d00f-4a5a-afc8-ff3f430a8e02", "name": "network-vif-deleted", "tag": "62ed6e5b-3c1f-49fa-b6a4-bf7a8952539f"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:01.325739 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:30:01.325739 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:30:01.344113 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-d54048d0-fe1e-4b31-80a2-8451636b8094 req-1c24faf1-fc0f-41a2-88f7-5675eecf6550 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:01.344113 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-d54048d0-fe1e-4b31-80a2-8451636b8094 req-1c24faf1-fc0f-41a2-88f7-5675eecf6550 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:01.364867 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-d54048d0-fe1e-4b31-80a2-8451636b8094 req-1c24faf1-fc0f-41a2-88f7-5675eecf6550 service nova] Creating event network-vif-deleted:62ed6e5b-3c1f-49fa-b6a4-bf7a8952539f for instance 162a716d-d00f-4a5a-afc8-ff3f430a8e02 on hv-cinder-81803 Dec 20 03:30:01.373820 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-d54048d0-fe1e-4b31-80a2-8451636b8094 req-1c24faf1-fc0f-41a2-88f7-5675eecf6550 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057456 Dec 20 03:30:01.375112 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 119/216] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:30:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:30:02.208598 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e61f8385-94d6-4961-a6d4-f33ce72845a2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:02.209593 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e61f8385-94d6-4961-a6d4-f33ce72845a2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:02.217546 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e61f8385-94d6-4961-a6d4-f33ce72845a2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:02.219040 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e61f8385-94d6-4961-a6d4-f33ce72845a2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:02.222848 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e61f8385-94d6-4961-a6d4-f33ce72845a2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:02.223602 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e61f8385-94d6-4961-a6d4-f33ce72845a2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:02.331135 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e61f8385-94d6-4961-a6d4-f33ce72845a2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 28605 microversion: 2.1 time: 0.125670 Dec 20 03:30:02.331361 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 98/217] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:30:02 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 28605 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:30:02.344328 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-6d3f44c6-99d2-4c6d-8864-0814fea04ffe tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:02.348482 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c7ef7c0a-bcea-4a50-96f7-e17e3e34376d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:02.349300 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c7ef7c0a-bcea-4a50-96f7-e17e3e34376d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:02.350758 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6d3f44c6-99d2-4c6d-8864-0814fea04ffe tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:02.357593 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c7ef7c0a-bcea-4a50-96f7-e17e3e34376d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:02.358050 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c7ef7c0a-bcea-4a50-96f7-e17e3e34376d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:02.358850 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c7ef7c0a-bcea-4a50-96f7-e17e3e34376d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:02.359463 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c7ef7c0a-bcea-4a50-96f7-e17e3e34376d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:02.368992 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6d3f44c6-99d2-4c6d-8864-0814fea04ffe tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:02.372582 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6d3f44c6-99d2-4c6d-8864-0814fea04ffe tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:02.373564 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6d3f44c6-99d2-4c6d-8864-0814fea04ffe tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:02.374009 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6d3f44c6-99d2-4c6d-8864-0814fea04ffe tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:02.434854 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6d3f44c6-99d2-4c6d-8864-0814fea04ffe tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:02.435672 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6d3f44c6-99d2-4c6d-8864-0814fea04ffe tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:02.436319 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.objects.instance [None req-6d3f44c6-99d2-4c6d-8864-0814fea04ffe tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lazy-loading 'fault' on Instance uuid 162a716d-d00f-4a5a-afc8-ff3f430a8e02 {{(pid=117011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:30:02.507912 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6d3f44c6-99d2-4c6d-8864-0814fea04ffe tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f07485037a476bba6071aa489ba402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd299791ac871430b94a15519afc05b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:02.521994 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-6d3f44c6-99d2-4c6d-8864-0814fea04ffe tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 200 len: 1350 microversion: 2.1 time: 0.187749 Dec 20 03:30:02.523872 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 120/218] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:02 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 1350 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:02.556789 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c7ef7c0a-bcea-4a50-96f7-e17e3e34376d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:02.576546 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c7ef7c0a-bcea-4a50-96f7-e17e3e34376d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1318 microversion: 2.1 time: 0.237761 Dec 20 03:30:02.577034 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 99/219] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:02 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:03.347034 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b1cdcf80-2cce-44f3-8663-65e308fb83c8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:03.348663 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-b1cdcf80-2cce-44f3-8663-65e308fb83c8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:03.355763 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b1cdcf80-2cce-44f3-8663-65e308fb83c8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:03.356465 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b1cdcf80-2cce-44f3-8663-65e308fb83c8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:03.357291 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b1cdcf80-2cce-44f3-8663-65e308fb83c8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:03.357721 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b1cdcf80-2cce-44f3-8663-65e308fb83c8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:03.448163 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b1cdcf80-2cce-44f3-8663-65e308fb83c8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 28605 microversion: 2.1 time: 0.105579 Dec 20 03:30:03.448813 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 121/220] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:30:03 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 28605 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:30:03.549751 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-39ec87a1-b45b-4d76-8ee7-f184302feec2 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:03.551197 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-39ec87a1-b45b-4d76-8ee7-f184302feec2 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:03.564840 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-39ec87a1-b45b-4d76-8ee7-f184302feec2 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:03.568587 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-39ec87a1-b45b-4d76-8ee7-f184302feec2 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:03.568587 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-39ec87a1-b45b-4d76-8ee7-f184302feec2 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:03.568587 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-39ec87a1-b45b-4d76-8ee7-f184302feec2 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:03.584109 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-39ec87a1-b45b-4d76-8ee7-f184302feec2 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] HTTP exception thrown: Instance 162a716d-d00f-4a5a-afc8-ff3f430a8e02 could not be found. Dec 20 03:30:03.584975 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-39ec87a1-b45b-4d76-8ee7-f184302feec2 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Returning 404 to user: Instance 162a716d-d00f-4a5a-afc8-ff3f430a8e02 could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:30:03.586062 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-39ec87a1-b45b-4d76-8ee7-f184302feec2 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 404 len: 111 microversion: 2.1 time: 0.040312 Dec 20 03:30:03.587398 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 100/221] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:03 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:30:03.614023 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-191cc393-6727-4b4a-bc6b-bfc17772838a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:03.616089 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-191cc393-6727-4b4a-bc6b-bfc17772838a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:03.630382 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-191cc393-6727-4b4a-bc6b-bfc17772838a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:03.631165 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-191cc393-6727-4b4a-bc6b-bfc17772838a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:03.632741 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-191cc393-6727-4b4a-bc6b-bfc17772838a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:03.633599 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-191cc393-6727-4b4a-bc6b-bfc17772838a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:03.767459 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f7839d07-ae94-449b-a01e-1e51c2140fdc tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:03.769964 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f7839d07-ae94-449b-a01e-1e51c2140fdc tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:03.780223 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f7839d07-ae94-449b-a01e-1e51c2140fdc tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:03.781051 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f7839d07-ae94-449b-a01e-1e51c2140fdc tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:03.782685 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f7839d07-ae94-449b-a01e-1e51c2140fdc tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:03.783717 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f7839d07-ae94-449b-a01e-1e51c2140fdc tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:03.849387 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-f7839d07-ae94-449b-a01e-1e51c2140fdc tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] HTTP exception thrown: Instance 162a716d-d00f-4a5a-afc8-ff3f430a8e02 could not be found. Dec 20 03:30:03.850612 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f7839d07-ae94-449b-a01e-1e51c2140fdc tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Returning 404 to user: Instance 162a716d-d00f-4a5a-afc8-ff3f430a8e02 could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:30:03.852575 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f7839d07-ae94-449b-a01e-1e51c2140fdc tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.092204 Dec 20 03:30:03.854582 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 101/222] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:30:03 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02/os-volume_attachments => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 20 03:30:04.008285 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-191cc393-6727-4b4a-bc6b-bfc17772838a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:04.016194 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-191cc393-6727-4b4a-bc6b-bfc17772838a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1318 microversion: 2.1 time: 0.411174 Dec 20 03:30:04.024635 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 122/223] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:03 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1318 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:04.468144 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-28d8dcc3-e3b8-402c-9b48-75ff4d445516 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:04.469544 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-28d8dcc3-e3b8-402c-9b48-75ff4d445516 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:04.477678 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-28d8dcc3-e3b8-402c-9b48-75ff4d445516 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:04.478500 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-28d8dcc3-e3b8-402c-9b48-75ff4d445516 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:04.479500 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-28d8dcc3-e3b8-402c-9b48-75ff4d445516 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:04.480243 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-28d8dcc3-e3b8-402c-9b48-75ff4d445516 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:04.600071 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-28d8dcc3-e3b8-402c-9b48-75ff4d445516 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 28758 microversion: 2.1 time: 0.136882 Dec 20 03:30:04.607794 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 102/224] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:30:04 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 28758 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:30:05.042733 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-188d22b7-94e2-466c-8b5b-eef78d1fa1aa tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:05.043554 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-188d22b7-94e2-466c-8b5b-eef78d1fa1aa tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:05.052162 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-188d22b7-94e2-466c-8b5b-eef78d1fa1aa tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:05.053038 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-188d22b7-94e2-466c-8b5b-eef78d1fa1aa tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:05.054497 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-188d22b7-94e2-466c-8b5b-eef78d1fa1aa tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:05.055022 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-188d22b7-94e2-466c-8b5b-eef78d1fa1aa tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:05.262232 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-188d22b7-94e2-466c-8b5b-eef78d1fa1aa tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:05.278423 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-188d22b7-94e2-466c-8b5b-eef78d1fa1aa tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1318 microversion: 2.1 time: 0.240895 Dec 20 03:30:05.280041 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 123/225] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:05 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:05.561724 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-2edfcef5-ce81-46ad-a247-d38f59525ae1 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:05.562666 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-2edfcef5-ce81-46ad-a247-d38f59525ae1 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:05.572630 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2edfcef5-ce81-46ad-a247-d38f59525ae1 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:05.573671 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2edfcef5-ce81-46ad-a247-d38f59525ae1 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:05.574644 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2edfcef5-ce81-46ad-a247-d38f59525ae1 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:05.575246 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2edfcef5-ce81-46ad-a247-d38f59525ae1 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:05.609441 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-2edfcef5-ce81-46ad-a247-d38f59525ae1 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] HTTP exception thrown: Instance 162a716d-d00f-4a5a-afc8-ff3f430a8e02 could not be found. Dec 20 03:30:05.610624 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-2edfcef5-ce81-46ad-a247-d38f59525ae1 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Returning 404 to user: Instance 162a716d-d00f-4a5a-afc8-ff3f430a8e02 could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:30:05.612516 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-2edfcef5-ce81-46ad-a247-d38f59525ae1 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "DELETE /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 404 len: 111 microversion: 2.1 time: 0.055591 Dec 20 03:30:05.615312 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 103/226] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:30:05 2021] DELETE /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:30:05.623276 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-508e63a8-3537-4b94-acfc-02612f47999c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:05.624509 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-508e63a8-3537-4b94-acfc-02612f47999c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:05.634500 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-78b61142-25d9-4c06-b7cd-ab3d8b6bbd45 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:05.635120 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-78b61142-25d9-4c06-b7cd-ab3d8b6bbd45 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] [instance: 162a716d-d00f-4a5a-afc8-ff3f430a8e02] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:05.637300 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-508e63a8-3537-4b94-acfc-02612f47999c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:05.637917 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-508e63a8-3537-4b94-acfc-02612f47999c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:05.638713 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-508e63a8-3537-4b94-acfc-02612f47999c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:05.639143 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-508e63a8-3537-4b94-acfc-02612f47999c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:05.657068 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-78b61142-25d9-4c06-b7cd-ab3d8b6bbd45 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:05.657220 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-78b61142-25d9-4c06-b7cd-ab3d8b6bbd45 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:05.662576 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-78b61142-25d9-4c06-b7cd-ab3d8b6bbd45 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:05.663190 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-78b61142-25d9-4c06-b7cd-ab3d8b6bbd45 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:05.740297 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-78b61142-25d9-4c06-b7cd-ab3d8b6bbd45 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] HTTP exception thrown: Instance 162a716d-d00f-4a5a-afc8-ff3f430a8e02 could not be found. Dec 20 03:30:05.740297 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-78b61142-25d9-4c06-b7cd-ab3d8b6bbd45 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] Returning 404 to user: Instance 162a716d-d00f-4a5a-afc8-ff3f430a8e02 could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:30:05.740297 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-78b61142-25d9-4c06-b7cd-ab3d8b6bbd45 tempest-DeleteServersTestJSON-144887283 tempest-DeleteServersTestJSON-144887283-project] 10.222.0.53 "GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02" status: 404 len: 111 microversion: 2.1 time: 0.069379 Dec 20 03:30:05.740297 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 104/227] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:05 2021] GET /compute/v2.1/servers/162a716d-d00f-4a5a-afc8-ff3f430a8e02 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:30:05.768140 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-508e63a8-3537-4b94-acfc-02612f47999c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 30558 microversion: 2.1 time: 0.148951 Dec 20 03:30:05.783789 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 124/228] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:30:05 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 30558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:30:06.275977 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-f2235a3a-980c-4af6-8dd1-4334de884955 req-55a039b2-dc87-435c-9120-ec7343815bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "193a15ec-d618-4edf-967c-09b3ccc4069e", "name": "network-vif-plugged", "status": "completed", "tag": "27cdf226-e684-4867-9d0a-236f8a22a8f4"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:06.276954 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:30:06.276954 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:30:06.300441 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-f2235a3a-980c-4af6-8dd1-4334de884955 req-55a039b2-dc87-435c-9120-ec7343815bc2 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:06.303465 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-f2235a3a-980c-4af6-8dd1-4334de884955 req-55a039b2-dc87-435c-9120-ec7343815bc2 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:06.306069 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-4fa71766-2710-4470-93a9-eec82c424a72 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:06.306069 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-4fa71766-2710-4470-93a9-eec82c424a72 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:06.316121 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4fa71766-2710-4470-93a9-eec82c424a72 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:06.317608 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4fa71766-2710-4470-93a9-eec82c424a72 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:06.319167 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4fa71766-2710-4470-93a9-eec82c424a72 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:06.319518 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4fa71766-2710-4470-93a9-eec82c424a72 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:06.341229 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-f2235a3a-980c-4af6-8dd1-4334de884955 req-55a039b2-dc87-435c-9120-ec7343815bc2 service nova] Creating event network-vif-plugged:27cdf226-e684-4867-9d0a-236f8a22a8f4 for instance 193a15ec-d618-4edf-967c-09b3ccc4069e on hv-cinder-81803 Dec 20 03:30:06.354560 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-f2235a3a-980c-4af6-8dd1-4334de884955 req-55a039b2-dc87-435c-9120-ec7343815bc2 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086747 Dec 20 03:30:06.355754 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 105/229] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:30:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:30:06.719984 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-4fa71766-2710-4470-93a9-eec82c424a72 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:06.728198 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-4fa71766-2710-4470-93a9-eec82c424a72 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1318 microversion: 2.1 time: 0.429501 Dec 20 03:30:06.728800 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 125/230] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:06 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:30:06.792928 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-b19686bd-e162-4cdc-9405-956ed8793f2b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:06.793983 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-b19686bd-e162-4cdc-9405-956ed8793f2b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:06.804729 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b19686bd-e162-4cdc-9405-956ed8793f2b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:06.805500 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b19686bd-e162-4cdc-9405-956ed8793f2b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:06.807109 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b19686bd-e162-4cdc-9405-956ed8793f2b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:06.808127 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b19686bd-e162-4cdc-9405-956ed8793f2b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:06.969419 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-b19686bd-e162-4cdc-9405-956ed8793f2b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 32407 microversion: 2.1 time: 0.181880 Dec 20 03:30:06.970216 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 106/231] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:30:06 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 32407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:30:07.749545 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-bc7e5013-acfc-4b89-9222-961f02f9f775 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:07.750594 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-bc7e5013-acfc-4b89-9222-961f02f9f775 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:07.765204 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bc7e5013-acfc-4b89-9222-961f02f9f775 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:07.765204 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bc7e5013-acfc-4b89-9222-961f02f9f775 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:07.766414 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bc7e5013-acfc-4b89-9222-961f02f9f775 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:07.767208 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bc7e5013-acfc-4b89-9222-961f02f9f775 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:08.033700 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a2f6e3f7-f4ee-4901-9f58-75a0ac87a2b2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:08.043837 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a2f6e3f7-f4ee-4901-9f58-75a0ac87a2b2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:08.082884 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a2f6e3f7-f4ee-4901-9f58-75a0ac87a2b2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:08.084179 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a2f6e3f7-f4ee-4901-9f58-75a0ac87a2b2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:08.088131 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a2f6e3f7-f4ee-4901-9f58-75a0ac87a2b2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:08.090778 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a2f6e3f7-f4ee-4901-9f58-75a0ac87a2b2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:08.124019 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-bc7e5013-acfc-4b89-9222-961f02f9f775 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:08.149070 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-bc7e5013-acfc-4b89-9222-961f02f9f775 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1318 microversion: 2.1 time: 0.406176 Dec 20 03:30:08.152430 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 126/232] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:07 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:08.318062 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a2f6e3f7-f4ee-4901-9f58-75a0ac87a2b2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 33326 microversion: 2.1 time: 0.337602 Dec 20 03:30:08.325228 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 107/233] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:30:07 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 33326 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:30:09.181236 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e34ca995-6695-45ca-bbbf-fc226dd16934 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:09.183330 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e34ca995-6695-45ca-bbbf-fc226dd16934 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:09.190177 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e34ca995-6695-45ca-bbbf-fc226dd16934 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:09.190634 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e34ca995-6695-45ca-bbbf-fc226dd16934 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:09.191828 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e34ca995-6695-45ca-bbbf-fc226dd16934 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:09.192269 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e34ca995-6695-45ca-bbbf-fc226dd16934 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:09.339748 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-6dccac4e-093a-405b-937c-0fe2051da76b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:09.352469 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6dccac4e-093a-405b-937c-0fe2051da76b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:09.365557 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6dccac4e-093a-405b-937c-0fe2051da76b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:09.366686 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6dccac4e-093a-405b-937c-0fe2051da76b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:09.369724 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6dccac4e-093a-405b-937c-0fe2051da76b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:09.371682 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6dccac4e-093a-405b-937c-0fe2051da76b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:09.449107 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-e34ca995-6695-45ca-bbbf-fc226dd16934 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:09.469546 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e34ca995-6695-45ca-bbbf-fc226dd16934 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1508 microversion: 2.1 time: 0.293978 Dec 20 03:30:09.471032 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 127/234] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:09 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1508 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:30:09.499760 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f8ac9cad-2188-41ff-a15a-f51f134037a4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18a9cc8c-e299-4917-b96d-8d3bdaa7acd2"}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:09.503514 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-f8ac9cad-2188-41ff-a15a-f51f134037a4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:09.514403 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f8ac9cad-2188-41ff-a15a-f51f134037a4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:09.515673 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f8ac9cad-2188-41ff-a15a-f51f134037a4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:09.517700 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f8ac9cad-2188-41ff-a15a-f51f134037a4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:09.518764 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f8ac9cad-2188-41ff-a15a-f51f134037a4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:09.535740 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-6dccac4e-093a-405b-937c-0fe2051da76b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 34090 microversion: 2.1 time: 0.201617 Dec 20 03:30:09.535740 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 108/235] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:30:09 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 34090 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:30:09.683113 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-f8ac9cad-2188-41ff-a15a-f51f134037a4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] HTTP exception thrown: Invalid volume: volume 18a9cc8c-e299-4917-b96d-8d3bdaa7acd2 is already attached to instances: f4d04a54-3696-41b9-95d8-aa2624b21b17 Dec 20 03:30:09.683749 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f8ac9cad-2188-41ff-a15a-f51f134037a4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Returning 400 to user: Invalid volume: volume 18a9cc8c-e299-4917-b96d-8d3bdaa7acd2 is already attached to instances: f4d04a54-3696-41b9-95d8-aa2624b21b17 {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:30:09.684957 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f8ac9cad-2188-41ff-a15a-f51f134037a4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "POST /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.192853 Dec 20 03:30:09.686118 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 128/236] 10.222.0.53 () {60 vars in 1322 bytes} [Mon Dec 20 03:30:09 2021] POST /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e/os-volume_attachments => generated 174 bytes in 195 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 20 03:30:09.814776 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-5638ebf0-59c3-4e0b-9e31-c5c428b45ba2 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:09.815965 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-5638ebf0-59c3-4e0b-9e31-c5c428b45ba2 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:09.829124 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5638ebf0-59c3-4e0b-9e31-c5c428b45ba2 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:09.829953 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5638ebf0-59c3-4e0b-9e31-c5c428b45ba2 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:09.831322 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5638ebf0-59c3-4e0b-9e31-c5c428b45ba2 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:09.831992 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5638ebf0-59c3-4e0b-9e31-c5c428b45ba2 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:10.024570 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.objects.instance [None req-5638ebf0-59c3-4e0b-9e31-c5c428b45ba2 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lazy-loading 'services' on Instance uuid f4d04a54-3696-41b9-95d8-aa2624b21b17 {{(pid=117012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:30:10.415135 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-5638ebf0-59c3-4e0b-9e31-c5c428b45ba2 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "DELETE /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17/os-volume_attachments/18a9cc8c-e299-4917-b96d-8d3bdaa7acd2" status: 202 len: 0 microversion: 2.1 time: 0.608112 Dec 20 03:30:10.428364 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 109/237] 10.222.0.53 () {58 vars in 1415 bytes} [Mon Dec 20 03:30:09 2021] DELETE /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17/os-volume_attachments/18a9cc8c-e299-4917-b96d-8d3bdaa7acd2 => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:30:10.445581 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-da880e6b-fdd7-437f-8a5c-bd5b3ef83e5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:10.447169 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-da880e6b-fdd7-437f-8a5c-bd5b3ef83e5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:10.457944 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-da880e6b-fdd7-437f-8a5c-bd5b3ef83e5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:10.458641 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-da880e6b-fdd7-437f-8a5c-bd5b3ef83e5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:10.460807 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-da880e6b-fdd7-437f-8a5c-bd5b3ef83e5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:10.461408 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-da880e6b-fdd7-437f-8a5c-bd5b3ef83e5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:10.501425 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-da880e6b-fdd7-437f-8a5c-bd5b3ef83e5f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068635 Dec 20 03:30:10.502154 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 129/238] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:30:10 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:30:10.561616 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e51a34c0-09fc-4155-aed3-d900ffdf348c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:10.564202 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e51a34c0-09fc-4155-aed3-d900ffdf348c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:10.580413 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e51a34c0-09fc-4155-aed3-d900ffdf348c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:10.585385 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e51a34c0-09fc-4155-aed3-d900ffdf348c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:10.585385 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e51a34c0-09fc-4155-aed3-d900ffdf348c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:10.586291 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e51a34c0-09fc-4155-aed3-d900ffdf348c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:10.725064 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e51a34c0-09fc-4155-aed3-d900ffdf348c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 35077 microversion: 2.1 time: 0.178424 Dec 20 03:30:10.726174 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 110/239] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:30:10 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 35077 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:30:11.513796 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-c5f3caf3-3076-4608-9c51-7bd0f06fd460 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:11.514778 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-c5f3caf3-3076-4608-9c51-7bd0f06fd460 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:11.522205 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c5f3caf3-3076-4608-9c51-7bd0f06fd460 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:11.522655 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c5f3caf3-3076-4608-9c51-7bd0f06fd460 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:11.523533 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c5f3caf3-3076-4608-9c51-7bd0f06fd460 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:11.524037 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c5f3caf3-3076-4608-9c51-7bd0f06fd460 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:11.560934 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-c5f3caf3-3076-4608-9c51-7bd0f06fd460 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050926 Dec 20 03:30:11.561547 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 130/240] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:30:11 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:30:11.745389 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1b7d396d-c356-41ee-ad15-dd1958666705 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:11.745389 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1b7d396d-c356-41ee-ad15-dd1958666705 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:11.753924 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1b7d396d-c356-41ee-ad15-dd1958666705 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:11.755237 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1b7d396d-c356-41ee-ad15-dd1958666705 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:11.756194 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1b7d396d-c356-41ee-ad15-dd1958666705 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:11.756761 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1b7d396d-c356-41ee-ad15-dd1958666705 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:11.865632 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1b7d396d-c356-41ee-ad15-dd1958666705 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 36171 microversion: 2.1 time: 0.130588 Dec 20 03:30:11.866661 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 111/241] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:30:11 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 36171 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:30:12.578780 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-299b075c-de5e-467b-9ddf-0e6bb73e5e29 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:12.583138 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-299b075c-de5e-467b-9ddf-0e6bb73e5e29 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:12.596267 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-299b075c-de5e-467b-9ddf-0e6bb73e5e29 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:12.596840 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-299b075c-de5e-467b-9ddf-0e6bb73e5e29 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:12.598295 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-299b075c-de5e-467b-9ddf-0e6bb73e5e29 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:12.598949 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-299b075c-de5e-467b-9ddf-0e6bb73e5e29 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:12.642977 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-299b075c-de5e-467b-9ddf-0e6bb73e5e29 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072256 Dec 20 03:30:12.650042 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 131/242] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:30:12 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 03:30:12.882846 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-56b151f9-5b4d-4ee4-b985-c3e513e79691 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:12.884509 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-56b151f9-5b4d-4ee4-b985-c3e513e79691 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:12.894119 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-56b151f9-5b4d-4ee4-b985-c3e513e79691 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:12.895251 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-56b151f9-5b4d-4ee4-b985-c3e513e79691 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:12.901971 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-56b151f9-5b4d-4ee4-b985-c3e513e79691 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:12.901971 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-56b151f9-5b4d-4ee4-b985-c3e513e79691 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:13.189689 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-56b151f9-5b4d-4ee4-b985-c3e513e79691 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 37652 microversion: 2.1 time: 0.314732 Dec 20 03:30:13.191635 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 112/243] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:30:12 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 37652 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:30:13.240994 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-25132be8-63e2-4928-b928-f446244c75cf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-983230191", "imageRef": "9c4ec443-915b-4997-82d3-08cc97ba635b", "flavorRef": "452", "networks": [{"uuid": "81fcedcc-7077-48be-86e2-d027fe8cf5ab"}]}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:13.358374 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.network.neutron [None req-25132be8-63e2-4928-b928-f446244c75cf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] validate_networks() for [('81fcedcc-7077-48be-86e2-d027fe8cf5ab', None, None, None, None, None)] {{(pid=117011) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:30:14.204602 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-b2e72003-5e67-47e2-b1e3-247a099940ae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:14.205672 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-b2e72003-5e67-47e2-b1e3-247a099940ae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:14.218584 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b2e72003-5e67-47e2-b1e3-247a099940ae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:14.218584 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b2e72003-5e67-47e2-b1e3-247a099940ae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:14.218584 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b2e72003-5e67-47e2-b1e3-247a099940ae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:14.218584 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b2e72003-5e67-47e2-b1e3-247a099940ae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:14.357318 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-b2e72003-5e67-47e2-b1e3-247a099940ae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 38128 microversion: 2.1 time: 0.156917 Dec 20 03:30:14.366133 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 113/244] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:30:14 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 38128 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:30:14.495442 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-25132be8-63e2-4928-b928-f446244c75cf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Flavor limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:30:14.496061 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-25132be8-63e2-4928-b928-f446244c75cf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Image limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:30:14.496377 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-25132be8-63e2-4928-b928-f446244c75cf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Flavor pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:30:14.496729 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-25132be8-63e2-4928-b928-f446244c75cf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Image pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:30:14.497187 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-25132be8-63e2-4928-b928-f446244c75cf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:30:14.511628 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-25132be8-63e2-4928-b928-f446244c75cf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:14.511628 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-25132be8-63e2-4928-b928-f446244c75cf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:14.511628 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-25132be8-63e2-4928-b928-f446244c75cf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:14.511628 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-25132be8-63e2-4928-b928-f446244c75cf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:14.530556 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-25132be8-63e2-4928-b928-f446244c75cf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Getting quotas for project 032e3b59ca34420bbb5bdcaaa1cbb72b. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:30:14.534875 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-25132be8-63e2-4928-b928-f446244c75cf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Getting quotas for user b9dcbac34c544fdea6152f710ab3d521 and project 032e3b59ca34420bbb5bdcaaa1cbb72b. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:30:14.548085 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-25132be8-63e2-4928-b928-f446244c75cf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Going to run 1 instances... {{(pid=117011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:30:14.550567 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-25132be8-63e2-4928-b928-f446244c75cf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c4ec443-915b-4997-82d3-08cc97ba635b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:30:14.819232 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-25132be8-63e2-4928-b928-f446244c75cf tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.602605 Dec 20 03:30:14.819909 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 132/245] 10.222.0.53 () {60 vars in 1146 bytes} [Mon Dec 20 03:30:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 1604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 03:30:14.835610 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-3a22b92b-57f7-4b70-95eb-6f12fe9e94ed tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:14.841721 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-3a22b92b-57f7-4b70-95eb-6f12fe9e94ed tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:14.960212 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-3a22b92b-57f7-4b70-95eb-6f12fe9e94ed tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:14.968464 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-3a22b92b-57f7-4b70-95eb-6f12fe9e94ed tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 200 len: 1217 microversion: 2.1 time: 0.141831 Dec 20 03:30:14.969500 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 114/246] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:14 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 1217 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:15.374749 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-00723adb-3515-4102-93e3-d8ff473c1dbf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:15.376120 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-00723adb-3515-4102-93e3-d8ff473c1dbf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:15.385215 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-00723adb-3515-4102-93e3-d8ff473c1dbf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:15.387484 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-00723adb-3515-4102-93e3-d8ff473c1dbf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:15.388371 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-00723adb-3515-4102-93e3-d8ff473c1dbf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:15.388814 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-00723adb-3515-4102-93e3-d8ff473c1dbf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:15.491836 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-00723adb-3515-4102-93e3-d8ff473c1dbf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 38128 microversion: 2.1 time: 0.121112 Dec 20 03:30:15.493875 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 133/247] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:30:15 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 38128 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:30:15.987024 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-9aae7bec-3c6d-4920-b53e-7b8964edd7da tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:15.988768 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-9aae7bec-3c6d-4920-b53e-7b8964edd7da tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:16.114108 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-9aae7bec-3c6d-4920-b53e-7b8964edd7da tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:16.127517 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-9aae7bec-3c6d-4920-b53e-7b8964edd7da tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 200 len: 1217 microversion: 2.1 time: 0.144770 Dec 20 03:30:16.129363 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 115/248] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:15 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 1217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:16.579016 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-64dbf185-e488-44bf-b4be-714cb46f6bba tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:16.580024 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-64dbf185-e488-44bf-b4be-714cb46f6bba tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:16.587916 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-64dbf185-e488-44bf-b4be-714cb46f6bba tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:16.588363 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-64dbf185-e488-44bf-b4be-714cb46f6bba tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:16.590785 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-64dbf185-e488-44bf-b4be-714cb46f6bba tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:16.590785 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-64dbf185-e488-44bf-b4be-714cb46f6bba tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:16.699423 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-64dbf185-e488-44bf-b4be-714cb46f6bba tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 38147 microversion: 2.1 time: 0.123999 Dec 20 03:30:16.700428 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 134/249] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:30:16 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 38147 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:30:17.147600 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1e688927-8017-4711-8ceb-b2824b18206c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:17.149844 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1e688927-8017-4711-8ceb-b2824b18206c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:17.161003 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1e688927-8017-4711-8ceb-b2824b18206c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:17.163161 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1e688927-8017-4711-8ceb-b2824b18206c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:17.164293 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1e688927-8017-4711-8ceb-b2824b18206c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:17.164928 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1e688927-8017-4711-8ceb-b2824b18206c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:17.330005 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1e688927-8017-4711-8ceb-b2824b18206c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:17.367815 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1e688927-8017-4711-8ceb-b2824b18206c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 200 len: 1213 microversion: 2.1 time: 0.210729 Dec 20 03:30:17.367815 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 116/250] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:17 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 1213 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:17.713267 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-3a9f07ec-3707-49ef-bc5c-a9ce3fa86490 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:17.715879 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-3a9f07ec-3707-49ef-bc5c-a9ce3fa86490 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:17.729914 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3a9f07ec-3707-49ef-bc5c-a9ce3fa86490 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:17.730373 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3a9f07ec-3707-49ef-bc5c-a9ce3fa86490 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:17.731172 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3a9f07ec-3707-49ef-bc5c-a9ce3fa86490 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:17.731651 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3a9f07ec-3707-49ef-bc5c-a9ce3fa86490 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:18.396487 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-8a56b132-80ca-4c3f-a31a-6198e3ca00b9 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:18.401444 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-8a56b132-80ca-4c3f-a31a-6198e3ca00b9 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:18.462358 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8a56b132-80ca-4c3f-a31a-6198e3ca00b9 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:18.469913 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8a56b132-80ca-4c3f-a31a-6198e3ca00b9 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:18.477038 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8a56b132-80ca-4c3f-a31a-6198e3ca00b9 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:18.479771 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8a56b132-80ca-4c3f-a31a-6198e3ca00b9 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:18.719580 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-8a56b132-80ca-4c3f-a31a-6198e3ca00b9 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:18.729765 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-8a56b132-80ca-4c3f-a31a-6198e3ca00b9 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 200 len: 1269 microversion: 2.1 time: 0.355775 Dec 20 03:30:18.731022 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 117/251] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:18 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 1269 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:30:19.762373 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-29a5cf4b-2869-4361-8828-e18f9c4424ec tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:19.763378 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-29a5cf4b-2869-4361-8828-e18f9c4424ec tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:19.779028 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-29a5cf4b-2869-4361-8828-e18f9c4424ec tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:19.779612 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-29a5cf4b-2869-4361-8828-e18f9c4424ec tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:19.780688 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-29a5cf4b-2869-4361-8828-e18f9c4424ec tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:19.781376 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-29a5cf4b-2869-4361-8828-e18f9c4424ec tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:19.951381 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-29a5cf4b-2869-4361-8828-e18f9c4424ec tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:19.963250 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-29a5cf4b-2869-4361-8828-e18f9c4424ec tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 200 len: 1269 microversion: 2.1 time: 0.204692 Dec 20 03:30:19.977458 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 118/252] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:19 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 1269 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:20.548508 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-3a9f07ec-3707-49ef-bc5c-a9ce3fa86490 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 200 len: 38259 microversion: 2.1 time: 2.839714 Dec 20 03:30:20.550545 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 135/253] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:30:17 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 38259 bytes in 2843 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:30:20.562375 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-47c60914-269e-4769-b62b-90aafbf83ad2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:20.562885 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-47c60914-269e-4769-b62b-90aafbf83ad2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:20.570454 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-47c60914-269e-4769-b62b-90aafbf83ad2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:20.571175 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-47c60914-269e-4769-b62b-90aafbf83ad2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:20.572288 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-47c60914-269e-4769-b62b-90aafbf83ad2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:20.572740 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-47c60914-269e-4769-b62b-90aafbf83ad2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:20.621536 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-47c60914-269e-4769-b62b-90aafbf83ad2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/ips" status: 200 len: 146 microversion: 2.1 time: 0.063037 Dec 20 03:30:20.622784 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 119/254] 10.222.0.53 () {58 vars in 1247 bytes} [Mon Dec 20 03:30:20 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/ips => generated 146 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:30:21.024663 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-64d7d6a2-debd-436f-b5ae-22b460aaa584 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:21.025686 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-64d7d6a2-debd-436f-b5ae-22b460aaa584 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:21.087488 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-64d7d6a2-debd-436f-b5ae-22b460aaa584 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:21.087986 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-64d7d6a2-debd-436f-b5ae-22b460aaa584 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:21.088848 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-64d7d6a2-debd-436f-b5ae-22b460aaa584 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:21.094989 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-64d7d6a2-debd-436f-b5ae-22b460aaa584 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:21.379410 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-64d7d6a2-debd-436f-b5ae-22b460aaa584 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:21.391124 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-64d7d6a2-debd-436f-b5ae-22b460aaa584 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 200 len: 1277 microversion: 2.1 time: 0.383250 Dec 20 03:30:21.407587 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 136/255] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:20 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 1277 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:22.419179 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-99ac8d0e-cfd5-481a-b544-9a101a223031 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:22.424938 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-99ac8d0e-cfd5-481a-b544-9a101a223031 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:22.433874 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-99ac8d0e-cfd5-481a-b544-9a101a223031 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:22.434799 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-99ac8d0e-cfd5-481a-b544-9a101a223031 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:22.436089 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-99ac8d0e-cfd5-481a-b544-9a101a223031 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:22.436713 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-99ac8d0e-cfd5-481a-b544-9a101a223031 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:22.774399 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-99ac8d0e-cfd5-481a-b544-9a101a223031 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:22.783194 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-99ac8d0e-cfd5-481a-b544-9a101a223031 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 200 len: 1317 microversion: 2.1 time: 0.367744 Dec 20 03:30:22.784489 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 137/256] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:22 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:23.079667 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e1c4010f-53e8-4b77-9c9f-8e85f008f67e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2003610749", "imageRef": "9c4ec443-915b-4997-82d3-08cc97ba635b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2ae3593-6ccd-4cce-a5cc-c36ec671fee9"}]}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:23.326229 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.network.neutron [None req-e1c4010f-53e8-4b77-9c9f-8e85f008f67e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] validate_networks() for [('b2ae3593-6ccd-4cce-a5cc-c36ec671fee9', None, None, None, None, None)] {{(pid=117012) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:30:23.802973 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-6b6340ca-629c-4656-b77b-47740c3c00f0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:23.803593 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6b6340ca-629c-4656-b77b-47740c3c00f0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:23.811432 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6b6340ca-629c-4656-b77b-47740c3c00f0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:23.811909 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6b6340ca-629c-4656-b77b-47740c3c00f0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:23.812714 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6b6340ca-629c-4656-b77b-47740c3c00f0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:23.813183 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6b6340ca-629c-4656-b77b-47740c3c00f0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:24.075742 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-e1c4010f-53e8-4b77-9c9f-8e85f008f67e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Flavor limits 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:30:24.076443 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-e1c4010f-53e8-4b77-9c9f-8e85f008f67e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Image limits 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:30:24.077084 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-e1c4010f-53e8-4b77-9c9f-8e85f008f67e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Flavor pref 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:30:24.077706 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-e1c4010f-53e8-4b77-9c9f-8e85f008f67e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Image pref 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:30:24.080708 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-e1c4010f-53e8-4b77-9c9f-8e85f008f67e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:30:24.107792 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e1c4010f-53e8-4b77-9c9f-8e85f008f67e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:24.108630 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e1c4010f-53e8-4b77-9c9f-8e85f008f67e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:24.114743 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e1c4010f-53e8-4b77-9c9f-8e85f008f67e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:24.115371 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e1c4010f-53e8-4b77-9c9f-8e85f008f67e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:24.161838 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-e1c4010f-53e8-4b77-9c9f-8e85f008f67e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Getting quotas for project 2685bc296a00477bb621dea25f74f6d1. Resources: {'instances', 'ram', 'cores'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:30:24.181479 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-e1c4010f-53e8-4b77-9c9f-8e85f008f67e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Getting quotas for user cdb4ec46c3a444d68005e0355a66775b and project 2685bc296a00477bb621dea25f74f6d1. Resources: {'instances', 'ram', 'cores'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:30:24.213972 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e1c4010f-53e8-4b77-9c9f-8e85f008f67e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Going to run 1 instances... {{(pid=117012) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:30:24.218830 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e1c4010f-53e8-4b77-9c9f-8e85f008f67e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c4ec443-915b-4997-82d3-08cc97ba635b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117012) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:30:24.346847 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6b6340ca-629c-4656-b77b-47740c3c00f0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:24.357429 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-6b6340ca-629c-4656-b77b-47740c3c00f0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 200 len: 1317 microversion: 2.1 time: 0.558207 Dec 20 03:30:24.360271 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 138/257] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:23 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 1317 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:30:24.406654 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-54958c66-37fe-4242-8312-6276eb856348 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50f40728-5a94-465f-8d9d-08ef0b989452"}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:24.407386 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-54958c66-37fe-4242-8312-6276eb856348 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:24.420474 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-54958c66-37fe-4242-8312-6276eb856348 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:24.421473 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-54958c66-37fe-4242-8312-6276eb856348 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:24.422558 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-54958c66-37fe-4242-8312-6276eb856348 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:24.424259 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-54958c66-37fe-4242-8312-6276eb856348 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:24.469112 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e1c4010f-53e8-4b77-9c9f-8e85f008f67e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.056235 Dec 20 03:30:24.471154 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 120/258] 10.222.0.53 () {60 vars in 1146 bytes} [Mon Dec 20 03:30:22 2021] POST /compute/v2.1/servers => generated 383 bytes in 2059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 03:30:24.495407 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-5fdd41a2-5a48-41fe-b189-f4de1b009690 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:24.497409 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-5fdd41a2-5a48-41fe-b189-f4de1b009690 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:24.667886 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-5fdd41a2-5a48-41fe-b189-f4de1b009690 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:24.684539 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-5fdd41a2-5a48-41fe-b189-f4de1b009690 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1222 microversion: 2.1 time: 0.200089 Dec 20 03:30:24.686293 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 121/259] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:24 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1222 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:24.719865 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-ae479349-65c6-410f-9f00-db66e5fc9bc3 req-91be6c63-36cb-41db-85a5-8fd2aa2098cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69cdeced-dc70-4b1b-826b-fc1e794fff2b", "tag": "0b3b2e1a-633d-4f16-a381-3c86b11ddb3f"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:24.725183 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:30:24.725183 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:30:24.739599 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-ae479349-65c6-410f-9f00-db66e5fc9bc3 req-91be6c63-36cb-41db-85a5-8fd2aa2098cb service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:24.740376 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-ae479349-65c6-410f-9f00-db66e5fc9bc3 req-91be6c63-36cb-41db-85a5-8fd2aa2098cb service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:24.777276 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-ae479349-65c6-410f-9f00-db66e5fc9bc3 req-91be6c63-36cb-41db-85a5-8fd2aa2098cb service nova] Creating event network-changed:0b3b2e1a-633d-4f16-a381-3c86b11ddb3f for instance 69cdeced-dc70-4b1b-826b-fc1e794fff2b on hv-cinder-81803 Dec 20 03:30:24.788303 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-ae479349-65c6-410f-9f00-db66e5fc9bc3 req-91be6c63-36cb-41db-85a5-8fd2aa2098cb service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099122 Dec 20 03:30:24.790156 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 122/260] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:30:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:30:25.049227 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e8c118a0-0c50-4ba2-b64b-d205a554f4d7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-681154752", "imageRef": "9c4ec443-915b-4997-82d3-08cc97ba635b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2ae3593-6ccd-4cce-a5cc-c36ec671fee9"}]}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:25.153051 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.network.neutron [None req-e8c118a0-0c50-4ba2-b64b-d205a554f4d7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] validate_networks() for [('b2ae3593-6ccd-4cce-a5cc-c36ec671fee9', None, None, None, None, None)] {{(pid=117012) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:30:25.960464 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-e8c118a0-0c50-4ba2-b64b-d205a554f4d7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Flavor limits 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:30:25.961536 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-e8c118a0-0c50-4ba2-b64b-d205a554f4d7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Image limits 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:30:25.962437 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-e8c118a0-0c50-4ba2-b64b-d205a554f4d7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Flavor pref 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:30:25.963305 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-e8c118a0-0c50-4ba2-b64b-d205a554f4d7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Image pref 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:30:25.963940 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-e8c118a0-0c50-4ba2-b64b-d205a554f4d7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:30:25.981657 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e8c118a0-0c50-4ba2-b64b-d205a554f4d7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:25.981657 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e8c118a0-0c50-4ba2-b64b-d205a554f4d7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:25.981657 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e8c118a0-0c50-4ba2-b64b-d205a554f4d7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:25.981657 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e8c118a0-0c50-4ba2-b64b-d205a554f4d7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:26.008215 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-e8c118a0-0c50-4ba2-b64b-d205a554f4d7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Getting quotas for project 2685bc296a00477bb621dea25f74f6d1. Resources: {'instances', 'ram', 'cores'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:30:26.015374 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-e8c118a0-0c50-4ba2-b64b-d205a554f4d7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Getting quotas for user cdb4ec46c3a444d68005e0355a66775b and project 2685bc296a00477bb621dea25f74f6d1. Resources: {'instances', 'ram', 'cores'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:30:26.021794 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-54958c66-37fe-4242-8312-6276eb856348 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.623976 Dec 20 03:30:26.037408 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 139/261] 10.222.0.53 () {60 vars in 1322 bytes} [Mon Dec 20 03:30:24 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/os-volume_attachments => generated 194 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:30:26.049875 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e8c118a0-0c50-4ba2-b64b-d205a554f4d7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Going to run 1 instances... {{(pid=117012) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:30:26.056441 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e8c118a0-0c50-4ba2-b64b-d205a554f4d7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c4ec443-915b-4997-82d3-08cc97ba635b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117012) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:30:26.073492 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-fb959c51-3e0d-409f-b24e-dba2463311e8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:26.078408 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-fb959c51-3e0d-409f-b24e-dba2463311e8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:26.094910 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fb959c51-3e0d-409f-b24e-dba2463311e8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:26.096122 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fb959c51-3e0d-409f-b24e-dba2463311e8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:26.098906 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fb959c51-3e0d-409f-b24e-dba2463311e8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:26.100629 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fb959c51-3e0d-409f-b24e-dba2463311e8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:26.303262 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e8c118a0-0c50-4ba2-b64b-d205a554f4d7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.266046 Dec 20 03:30:26.303914 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 123/262] 10.222.0.53 () {60 vars in 1146 bytes} [Mon Dec 20 03:30:25 2021] POST /compute/v2.1/servers => generated 383 bytes in 1269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 20 03:30:26.318050 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7dc48e0f-06cc-4335-bc86-ee6315f29cce tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:26.318698 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-7dc48e0f-06cc-4335-bc86-ee6315f29cce tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:26.420316 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7dc48e0f-06cc-4335-bc86-ee6315f29cce tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:26.430845 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7dc48e0f-06cc-4335-bc86-ee6315f29cce tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1221 microversion: 2.1 time: 0.117640 Dec 20 03:30:26.431445 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 124/263] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:26 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1221 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:30:26.666144 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-fb959c51-3e0d-409f-b24e-dba2463311e8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:26.693893 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-fb959c51-3e0d-409f-b24e-dba2463311e8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 200 len: 1317 microversion: 2.1 time: 0.652125 Dec 20 03:30:26.701204 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 140/264] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:26 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 1317 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:27.455504 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-39d65a5d-56d8-437e-8a08-da0b16b88ef5 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:27.456520 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-39d65a5d-56d8-437e-8a08-da0b16b88ef5 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:27.547751 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-39d65a5d-56d8-437e-8a08-da0b16b88ef5 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:27.556242 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-39d65a5d-56d8-437e-8a08-da0b16b88ef5 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1221 microversion: 2.1 time: 0.104456 Dec 20 03:30:27.556832 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 125/265] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:27 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1221 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:27.712295 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1a9d1e76-d82d-4770-bd9d-4d8f78e66744 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:27.713413 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1a9d1e76-d82d-4770-bd9d-4d8f78e66744 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:27.725467 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1a9d1e76-d82d-4770-bd9d-4d8f78e66744 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:27.726130 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1a9d1e76-d82d-4770-bd9d-4d8f78e66744 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:27.728303 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1a9d1e76-d82d-4770-bd9d-4d8f78e66744 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:27.729338 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1a9d1e76-d82d-4770-bd9d-4d8f78e66744 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:27.912829 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-1a9d1e76-d82d-4770-bd9d-4d8f78e66744 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:27.929971 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1a9d1e76-d82d-4770-bd9d-4d8f78e66744 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 200 len: 1317 microversion: 2.1 time: 0.222099 Dec 20 03:30:27.930625 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 141/266] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:27 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:28.577226 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d0df461c-cacd-4f4d-9dc0-fd2ece73b3f1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:28.579593 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d0df461c-cacd-4f4d-9dc0-fd2ece73b3f1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:28.611200 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d0df461c-cacd-4f4d-9dc0-fd2ece73b3f1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:28.611200 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d0df461c-cacd-4f4d-9dc0-fd2ece73b3f1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:28.611200 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d0df461c-cacd-4f4d-9dc0-fd2ece73b3f1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:28.611200 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d0df461c-cacd-4f4d-9dc0-fd2ece73b3f1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:28.716323 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d0df461c-cacd-4f4d-9dc0-fd2ece73b3f1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:28.726057 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d0df461c-cacd-4f4d-9dc0-fd2ece73b3f1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1217 microversion: 2.1 time: 0.156245 Dec 20 03:30:28.731834 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 126/267] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:28 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:28.953290 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-2ffdc713-10f8-4548-a26b-59b5552da82b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:28.954158 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-2ffdc713-10f8-4548-a26b-59b5552da82b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:28.963441 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2ffdc713-10f8-4548-a26b-59b5552da82b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:28.963736 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2ffdc713-10f8-4548-a26b-59b5552da82b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:28.964534 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2ffdc713-10f8-4548-a26b-59b5552da82b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:28.964967 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2ffdc713-10f8-4548-a26b-59b5552da82b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:29.546177 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-2ffdc713-10f8-4548-a26b-59b5552da82b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:29.569330 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-2ffdc713-10f8-4548-a26b-59b5552da82b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 200 len: 1317 microversion: 2.1 time: 0.625359 Dec 20 03:30:29.569920 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 142/268] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:28 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 1317 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:29.744722 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ba520ee4-889c-4260-8e1c-65060a34f4de tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:29.747529 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ba520ee4-889c-4260-8e1c-65060a34f4de tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:29.756518 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ba520ee4-889c-4260-8e1c-65060a34f4de tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:29.757556 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ba520ee4-889c-4260-8e1c-65060a34f4de tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:29.758845 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ba520ee4-889c-4260-8e1c-65060a34f4de tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:29.759655 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ba520ee4-889c-4260-8e1c-65060a34f4de tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:29.898564 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-ba520ee4-889c-4260-8e1c-65060a34f4de tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:29.907338 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ba520ee4-889c-4260-8e1c-65060a34f4de tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1273 microversion: 2.1 time: 0.166465 Dec 20 03:30:29.908260 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 127/269] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:29 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1273 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:30.592412 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-42dd0455-83ef-456d-86cc-40098f04935d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:30.593509 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-42dd0455-83ef-456d-86cc-40098f04935d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:30.605491 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-42dd0455-83ef-456d-86cc-40098f04935d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:30.606328 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-42dd0455-83ef-456d-86cc-40098f04935d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:30.607478 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-42dd0455-83ef-456d-86cc-40098f04935d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:30.608136 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-42dd0455-83ef-456d-86cc-40098f04935d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:30.936906 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c5ddf6d6-d3cb-437e-a1b4-e5e4b48bd527 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:30.938355 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c5ddf6d6-d3cb-437e-a1b4-e5e4b48bd527 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:30.946392 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c5ddf6d6-d3cb-437e-a1b4-e5e4b48bd527 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:30.947074 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c5ddf6d6-d3cb-437e-a1b4-e5e4b48bd527 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:30.948118 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c5ddf6d6-d3cb-437e-a1b4-e5e4b48bd527 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:30.948765 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c5ddf6d6-d3cb-437e-a1b4-e5e4b48bd527 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:31.044895 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-42dd0455-83ef-456d-86cc-40098f04935d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:31.054936 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-42dd0455-83ef-456d-86cc-40098f04935d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 200 len: 1317 microversion: 2.1 time: 0.469848 Dec 20 03:30:31.056236 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 143/270] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:30 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:31.064875 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-6a729920-4963-43ac-86de-0ee6d8b6df79 req-03b268f4-2616-4a48-ac93-57f78bb52ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69cdeced-dc70-4b1b-826b-fc1e794fff2b", "name": "network-vif-plugged", "status": "completed", "tag": "0b3b2e1a-633d-4f16-a381-3c86b11ddb3f"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:31.067851 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:30:31.067851 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:30:31.078304 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-6a729920-4963-43ac-86de-0ee6d8b6df79 req-03b268f4-2616-4a48-ac93-57f78bb52ba8 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:31.079345 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-6a729920-4963-43ac-86de-0ee6d8b6df79 req-03b268f4-2616-4a48-ac93-57f78bb52ba8 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:31.122278 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-6a729920-4963-43ac-86de-0ee6d8b6df79 req-03b268f4-2616-4a48-ac93-57f78bb52ba8 service nova] Creating event network-vif-plugged:0b3b2e1a-633d-4f16-a381-3c86b11ddb3f for instance 69cdeced-dc70-4b1b-826b-fc1e794fff2b on hv-cinder-81803 Dec 20 03:30:31.129058 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c5ddf6d6-d3cb-437e-a1b4-e5e4b48bd527 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:31.139415 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c5ddf6d6-d3cb-437e-a1b4-e5e4b48bd527 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1279 microversion: 2.1 time: 0.210288 Dec 20 03:30:31.146652 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 128/271] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:30 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1279 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:30:31.151734 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-555afa44-91db-4fdd-92ec-178e91076221 req-4ebac6a9-05a1-4157-bf72-7c679bff4d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e5cfe95-9804-4406-a893-82b021de3826", "tag": "9885c0f5-72c6-4249-b8f6-5755a026febe"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:31.158629 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:30:31.158629 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:30:31.181585 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-555afa44-91db-4fdd-92ec-178e91076221 req-4ebac6a9-05a1-4157-bf72-7c679bff4d34 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:31.181585 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-555afa44-91db-4fdd-92ec-178e91076221 req-4ebac6a9-05a1-4157-bf72-7c679bff4d34 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:31.186373 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-6a729920-4963-43ac-86de-0ee6d8b6df79 req-03b268f4-2616-4a48-ac93-57f78bb52ba8 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127875 Dec 20 03:30:31.209930 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 144/272] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:30:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:30:31.221316 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-555afa44-91db-4fdd-92ec-178e91076221 req-4ebac6a9-05a1-4157-bf72-7c679bff4d34 service nova] Creating event network-changed:9885c0f5-72c6-4249-b8f6-5755a026febe for instance 4e5cfe95-9804-4406-a893-82b021de3826 on hv-cinder-81803 Dec 20 03:30:31.232067 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-555afa44-91db-4fdd-92ec-178e91076221 req-4ebac6a9-05a1-4157-bf72-7c679bff4d34 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081379 Dec 20 03:30:31.237108 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 129/273] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:30:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:30:32.077133 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-864b468b-df94-4705-93db-1b531df12348 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:32.078040 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-864b468b-df94-4705-93db-1b531df12348 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:32.089388 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-864b468b-df94-4705-93db-1b531df12348 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:32.090174 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-864b468b-df94-4705-93db-1b531df12348 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:32.092214 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-864b468b-df94-4705-93db-1b531df12348 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:32.092982 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-864b468b-df94-4705-93db-1b531df12348 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:32.177521 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e22d34e7-d94c-44fd-bfe0-dfc37e40d203 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:32.177521 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e22d34e7-d94c-44fd-bfe0-dfc37e40d203 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:32.212439 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e22d34e7-d94c-44fd-bfe0-dfc37e40d203 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:32.213421 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e22d34e7-d94c-44fd-bfe0-dfc37e40d203 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:32.214851 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e22d34e7-d94c-44fd-bfe0-dfc37e40d203 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:32.215593 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e22d34e7-d94c-44fd-bfe0-dfc37e40d203 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:32.346692 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-864b468b-df94-4705-93db-1b531df12348 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:32.355674 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-864b468b-df94-4705-93db-1b531df12348 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 200 len: 1317 microversion: 2.1 time: 0.283547 Dec 20 03:30:32.367346 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 145/274] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:32 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:32.553190 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-e22d34e7-d94c-44fd-bfe0-dfc37e40d203 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:32.561063 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e22d34e7-d94c-44fd-bfe0-dfc37e40d203 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1321 microversion: 2.1 time: 0.397483 Dec 20 03:30:32.561695 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 130/275] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:32 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1321 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:33.374746 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-6393af2b-9301-4447-a06b-3cf4900c3aa5 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:33.375360 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6393af2b-9301-4447-a06b-3cf4900c3aa5 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:33.385684 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6393af2b-9301-4447-a06b-3cf4900c3aa5 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:33.386588 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6393af2b-9301-4447-a06b-3cf4900c3aa5 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:33.387498 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6393af2b-9301-4447-a06b-3cf4900c3aa5 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:33.388007 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6393af2b-9301-4447-a06b-3cf4900c3aa5 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:33.580596 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d9d9d333-d04f-4e4f-a226-14e0cf4dc9aa tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:33.581406 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d9d9d333-d04f-4e4f-a226-14e0cf4dc9aa tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:33.590567 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d9d9d333-d04f-4e4f-a226-14e0cf4dc9aa tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:33.591407 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d9d9d333-d04f-4e4f-a226-14e0cf4dc9aa tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:33.592717 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d9d9d333-d04f-4e4f-a226-14e0cf4dc9aa tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:33.594555 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d9d9d333-d04f-4e4f-a226-14e0cf4dc9aa tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:33.652269 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6393af2b-9301-4447-a06b-3cf4900c3aa5 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:33.675996 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-6393af2b-9301-4447-a06b-3cf4900c3aa5 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 200 len: 1317 microversion: 2.1 time: 0.298991 Dec 20 03:30:33.675996 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 146/276] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:33 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:33.810550 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d9d9d333-d04f-4e4f-a226-14e0cf4dc9aa tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:33.819836 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d9d9d333-d04f-4e4f-a226-14e0cf4dc9aa tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1321 microversion: 2.1 time: 0.243989 Dec 20 03:30:33.820665 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 131/277] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:33 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:30:34.692935 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-9d4736c4-69de-410a-b62c-04761aabc985 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:34.693908 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-9d4736c4-69de-410a-b62c-04761aabc985 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:34.700412 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9d4736c4-69de-410a-b62c-04761aabc985 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:34.713933 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9d4736c4-69de-410a-b62c-04761aabc985 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:34.713933 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9d4736c4-69de-410a-b62c-04761aabc985 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:34.713933 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9d4736c4-69de-410a-b62c-04761aabc985 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:34.847776 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-90c0ff55-6608-4f87-97bc-de042bddb386 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:34.849250 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-90c0ff55-6608-4f87-97bc-de042bddb386 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:34.864781 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-90c0ff55-6608-4f87-97bc-de042bddb386 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:34.866530 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-90c0ff55-6608-4f87-97bc-de042bddb386 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:34.870844 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-90c0ff55-6608-4f87-97bc-de042bddb386 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:34.871542 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-90c0ff55-6608-4f87-97bc-de042bddb386 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:35.119511 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-90c0ff55-6608-4f87-97bc-de042bddb386 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:35.132485 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-90c0ff55-6608-4f87-97bc-de042bddb386 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1321 microversion: 2.1 time: 0.292524 Dec 20 03:30:35.136898 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 132/278] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:34 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1321 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:35.451819 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9d4736c4-69de-410a-b62c-04761aabc985 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:35.469927 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-9d4736c4-69de-410a-b62c-04761aabc985 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 200 len: 1317 microversion: 2.1 time: 0.780335 Dec 20 03:30:35.477486 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 147/279] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:34 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 1317 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:36.175261 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-48715896-6a91-448f-9e8a-a92e6b4e2ae5 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:36.177078 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-48715896-6a91-448f-9e8a-a92e6b4e2ae5 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:36.208397 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-48715896-6a91-448f-9e8a-a92e6b4e2ae5 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:36.208888 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-48715896-6a91-448f-9e8a-a92e6b4e2ae5 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:36.209824 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-48715896-6a91-448f-9e8a-a92e6b4e2ae5 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:36.210289 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-48715896-6a91-448f-9e8a-a92e6b4e2ae5 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:36.495900 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-2fa8d79b-264e-4071-8ea6-1a5fdb90b899 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:36.497238 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-2fa8d79b-264e-4071-8ea6-1a5fdb90b899 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:36.507802 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2fa8d79b-264e-4071-8ea6-1a5fdb90b899 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:36.515567 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2fa8d79b-264e-4071-8ea6-1a5fdb90b899 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:36.526523 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2fa8d79b-264e-4071-8ea6-1a5fdb90b899 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:36.526523 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2fa8d79b-264e-4071-8ea6-1a5fdb90b899 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:36.607994 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-48715896-6a91-448f-9e8a-a92e6b4e2ae5 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:36.619521 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-48715896-6a91-448f-9e8a-a92e6b4e2ae5 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1321 microversion: 2.1 time: 0.453982 Dec 20 03:30:36.620373 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 133/280] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:36 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:36.827511 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-4b1e0b0c-3bc1-48ba-a60e-93a7be7040ea req-fe65edf3-f348-4c9c-921e-7a4883b7e370 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac8535fe-2f8e-4681-a5ba-7d6ee956b779", "tag": "176ceebe-9cae-40dc-8342-df2cb17a5f92"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:36.830314 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-2fa8d79b-264e-4071-8ea6-1a5fdb90b899 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:36.836700 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:30:36.836700 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:30:36.848668 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-4b1e0b0c-3bc1-48ba-a60e-93a7be7040ea req-fe65edf3-f348-4c9c-921e-7a4883b7e370 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:36.849115 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-4b1e0b0c-3bc1-48ba-a60e-93a7be7040ea req-fe65edf3-f348-4c9c-921e-7a4883b7e370 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:36.857812 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-2fa8d79b-264e-4071-8ea6-1a5fdb90b899 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 200 len: 1507 microversion: 2.1 time: 0.365926 Dec 20 03:30:36.865428 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 148/281] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:36 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:36.877799 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-4b1e0b0c-3bc1-48ba-a60e-93a7be7040ea req-fe65edf3-f348-4c9c-921e-7a4883b7e370 service nova] Creating event network-changed:176ceebe-9cae-40dc-8342-df2cb17a5f92 for instance ac8535fe-2f8e-4681-a5ba-7d6ee956b779 on hv-cinder-81803 Dec 20 03:30:36.885523 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-4b1e0b0c-3bc1-48ba-a60e-93a7be7040ea req-fe65edf3-f348-4c9c-921e-7a4883b7e370 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061285 Dec 20 03:30:36.885523 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 134/282] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:30:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:30:37.648561 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d1f4d073-1395-46e4-a84f-2008ddf1d4e7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:37.649462 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d1f4d073-1395-46e4-a84f-2008ddf1d4e7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:37.658645 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d1f4d073-1395-46e4-a84f-2008ddf1d4e7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:37.659139 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d1f4d073-1395-46e4-a84f-2008ddf1d4e7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:37.660662 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d1f4d073-1395-46e4-a84f-2008ddf1d4e7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:37.661429 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d1f4d073-1395-46e4-a84f-2008ddf1d4e7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:37.892801 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d1f4d073-1395-46e4-a84f-2008ddf1d4e7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:37.908822 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d1f4d073-1395-46e4-a84f-2008ddf1d4e7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1321 microversion: 2.1 time: 0.263749 Dec 20 03:30:37.910919 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 149/283] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:37 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:38.107161 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ed02be16-e0cb-4236-b8e3-08326e5e6b1f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:38.118569 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ed02be16-e0cb-4236-b8e3-08326e5e6b1f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:38.124830 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ed02be16-e0cb-4236-b8e3-08326e5e6b1f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:38.200672 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ed02be16-e0cb-4236-b8e3-08326e5e6b1f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Going to try to stop instance {{(pid=117012) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 20 03:30:38.426252 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ed02be16-e0cb-4236-b8e3-08326e5e6b1f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 202 len: 0 microversion: 2.1 time: 0.322881 Dec 20 03:30:38.426886 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 135/284] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:30:38 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:30:38.437682 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-029f5745-8916-4dcf-b93a-8707cf4c1013 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:38.439061 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-029f5745-8916-4dcf-b93a-8707cf4c1013 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:38.449171 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-029f5745-8916-4dcf-b93a-8707cf4c1013 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:38.449842 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-029f5745-8916-4dcf-b93a-8707cf4c1013 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:38.451161 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-029f5745-8916-4dcf-b93a-8707cf4c1013 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:38.451896 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-029f5745-8916-4dcf-b93a-8707cf4c1013 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:38.670175 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-029f5745-8916-4dcf-b93a-8707cf4c1013 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:38.683210 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-029f5745-8916-4dcf-b93a-8707cf4c1013 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.250979 Dec 20 03:30:38.683744 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 150/285] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:38 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:38.929089 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ee352d59-a2cd-4cc7-98a1-d52df8849cd6 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:38.929967 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ee352d59-a2cd-4cc7-98a1-d52df8849cd6 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:38.940219 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ee352d59-a2cd-4cc7-98a1-d52df8849cd6 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:38.941575 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ee352d59-a2cd-4cc7-98a1-d52df8849cd6 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:38.942979 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ee352d59-a2cd-4cc7-98a1-d52df8849cd6 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:38.943763 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ee352d59-a2cd-4cc7-98a1-d52df8849cd6 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:39.127184 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-ee352d59-a2cd-4cc7-98a1-d52df8849cd6 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:39.136481 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ee352d59-a2cd-4cc7-98a1-d52df8849cd6 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1321 microversion: 2.1 time: 0.212023 Dec 20 03:30:39.137079 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 136/286] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:38 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:39.701880 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a52af4f3-6edf-4e9a-82fe-7f9c6f87b5be tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:39.705784 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a52af4f3-6edf-4e9a-82fe-7f9c6f87b5be tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:39.712642 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a52af4f3-6edf-4e9a-82fe-7f9c6f87b5be tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:39.713094 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a52af4f3-6edf-4e9a-82fe-7f9c6f87b5be tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:39.714418 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a52af4f3-6edf-4e9a-82fe-7f9c6f87b5be tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:39.714882 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a52af4f3-6edf-4e9a-82fe-7f9c6f87b5be tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:40.002240 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-a52af4f3-6edf-4e9a-82fe-7f9c6f87b5be tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:40.020423 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a52af4f3-6edf-4e9a-82fe-7f9c6f87b5be tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.322323 Dec 20 03:30:40.021302 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 151/287] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:39 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:40.162555 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-76c52f0c-5bf2-4ad9-916d-7e3ecf57374b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:40.163464 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-76c52f0c-5bf2-4ad9-916d-7e3ecf57374b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:40.209446 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-76c52f0c-5bf2-4ad9-916d-7e3ecf57374b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:40.211311 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-76c52f0c-5bf2-4ad9-916d-7e3ecf57374b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:40.213638 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-76c52f0c-5bf2-4ad9-916d-7e3ecf57374b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:40.214913 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-76c52f0c-5bf2-4ad9-916d-7e3ecf57374b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:40.453536 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-76c52f0c-5bf2-4ad9-916d-7e3ecf57374b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:40.466486 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-76c52f0c-5bf2-4ad9-916d-7e3ecf57374b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1321 microversion: 2.1 time: 0.310861 Dec 20 03:30:40.467159 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 137/288] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:40 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:41.051469 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-c0ba14c6-b107-4d72-9717-7844ccb7fde5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:41.052607 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-c0ba14c6-b107-4d72-9717-7844ccb7fde5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:41.067672 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c0ba14c6-b107-4d72-9717-7844ccb7fde5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:41.068154 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c0ba14c6-b107-4d72-9717-7844ccb7fde5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:41.069772 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c0ba14c6-b107-4d72-9717-7844ccb7fde5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:41.070546 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c0ba14c6-b107-4d72-9717-7844ccb7fde5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:41.430530 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-c0ba14c6-b107-4d72-9717-7844ccb7fde5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:41.447324 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-c0ba14c6-b107-4d72-9717-7844ccb7fde5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.403811 Dec 20 03:30:41.448891 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 152/289] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:41 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:41.487198 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7fee0633-076d-4790-9af0-26a7990960f0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:41.487791 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-7fee0633-076d-4790-9af0-26a7990960f0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:41.497253 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7fee0633-076d-4790-9af0-26a7990960f0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:41.498204 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7fee0633-076d-4790-9af0-26a7990960f0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:41.498498 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7fee0633-076d-4790-9af0-26a7990960f0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:41.499226 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7fee0633-076d-4790-9af0-26a7990960f0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:41.649021 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1978cd7f-b2bb-430f-9c7c-e152e10b0cdc tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5cede403-2f14-41d8-bb2f-126b749ec98d"}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:41.650426 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1978cd7f-b2bb-430f-9c7c-e152e10b0cdc tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:41.666178 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1978cd7f-b2bb-430f-9c7c-e152e10b0cdc tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:41.666901 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1978cd7f-b2bb-430f-9c7c-e152e10b0cdc tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:41.667723 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1978cd7f-b2bb-430f-9c7c-e152e10b0cdc tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:41.668313 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1978cd7f-b2bb-430f-9c7c-e152e10b0cdc tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:41.736217 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7fee0633-076d-4790-9af0-26a7990960f0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:41.745748 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7fee0633-076d-4790-9af0-26a7990960f0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1321 microversion: 2.1 time: 0.264040 Dec 20 03:30:41.748208 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 138/290] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:41 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:30:42.155805 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-8e06b14c-877b-45aa-b8ae-16931c449f85 req-a7d8f5c0-1169-4878-a11d-0c27ab671ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e5cfe95-9804-4406-a893-82b021de3826", "name": "network-vif-plugged", "status": "completed", "tag": "9885c0f5-72c6-4249-b8f6-5755a026febe"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:42.157741 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:30:42.157741 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:30:42.181742 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-8e06b14c-877b-45aa-b8ae-16931c449f85 req-a7d8f5c0-1169-4878-a11d-0c27ab671ad8 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:42.182260 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-8e06b14c-877b-45aa-b8ae-16931c449f85 req-a7d8f5c0-1169-4878-a11d-0c27ab671ad8 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:42.213248 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-8e06b14c-877b-45aa-b8ae-16931c449f85 req-a7d8f5c0-1169-4878-a11d-0c27ab671ad8 service nova] Creating event network-vif-plugged:9885c0f5-72c6-4249-b8f6-5755a026febe for instance 4e5cfe95-9804-4406-a893-82b021de3826 on hv-cinder-81803 Dec 20 03:30:42.226408 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-8e06b14c-877b-45aa-b8ae-16931c449f85 req-a7d8f5c0-1169-4878-a11d-0c27ab671ad8 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073936 Dec 20 03:30:42.231879 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 139/291] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:30:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:30:42.470893 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-92b12034-c61c-4b58-b5d4-67f406a7576f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:42.471398 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-92b12034-c61c-4b58-b5d4-67f406a7576f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:42.483492 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-92b12034-c61c-4b58-b5d4-67f406a7576f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:42.488432 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-92b12034-c61c-4b58-b5d4-67f406a7576f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:42.491489 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-92b12034-c61c-4b58-b5d4-67f406a7576f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:42.492214 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-92b12034-c61c-4b58-b5d4-67f406a7576f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:42.677963 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-92b12034-c61c-4b58-b5d4-67f406a7576f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:42.695880 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-92b12034-c61c-4b58-b5d4-67f406a7576f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.229053 Dec 20 03:30:42.696809 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 140/292] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:42 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:42.768286 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-4cf370c2-2dcb-43f2-9c4d-ae2685ab2f08 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:42.770341 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-4cf370c2-2dcb-43f2-9c4d-ae2685ab2f08 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:42.786938 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4cf370c2-2dcb-43f2-9c4d-ae2685ab2f08 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:42.789051 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4cf370c2-2dcb-43f2-9c4d-ae2685ab2f08 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:42.791241 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4cf370c2-2dcb-43f2-9c4d-ae2685ab2f08 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:42.792034 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4cf370c2-2dcb-43f2-9c4d-ae2685ab2f08 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:43.020837 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-4cf370c2-2dcb-43f2-9c4d-ae2685ab2f08 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:43.029317 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-4cf370c2-2dcb-43f2-9c4d-ae2685ab2f08 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1321 microversion: 2.1 time: 0.270163 Dec 20 03:30:43.030035 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 141/293] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:42 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:30:43.146857 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1978cd7f-b2bb-430f-9c7c-e152e10b0cdc tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "POST /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.502834 Dec 20 03:30:43.148221 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 153/294] 10.222.0.53 () {60 vars in 1322 bytes} [Mon Dec 20 03:30:41 2021] POST /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b/os-volume_attachments => generated 194 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:30:43.731965 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-5d8edb00-245c-4672-a899-31da07ced1a6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:43.732630 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-5d8edb00-245c-4672-a899-31da07ced1a6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:43.740845 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5d8edb00-245c-4672-a899-31da07ced1a6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:43.741407 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5d8edb00-245c-4672-a899-31da07ced1a6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:43.742166 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5d8edb00-245c-4672-a899-31da07ced1a6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:43.742609 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5d8edb00-245c-4672-a899-31da07ced1a6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:43.922538 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-5d8edb00-245c-4672-a899-31da07ced1a6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:43.932452 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-5d8edb00-245c-4672-a899-31da07ced1a6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.204188 Dec 20 03:30:43.933216 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 142/295] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:43 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:44.047575 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-9dfc1999-efec-402e-93f0-062f8ce2de7e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:44.050061 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-9dfc1999-efec-402e-93f0-062f8ce2de7e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:44.059137 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9dfc1999-efec-402e-93f0-062f8ce2de7e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:44.060304 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9dfc1999-efec-402e-93f0-062f8ce2de7e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:44.061130 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9dfc1999-efec-402e-93f0-062f8ce2de7e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:44.061644 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9dfc1999-efec-402e-93f0-062f8ce2de7e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:44.310393 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9dfc1999-efec-402e-93f0-062f8ce2de7e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:44.339210 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-9dfc1999-efec-402e-93f0-062f8ce2de7e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1321 microversion: 2.1 time: 0.294438 Dec 20 03:30:44.339210 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 154/296] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:44 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:30:44.956099 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1b751b39-061b-42bb-8685-f063f11d0ff8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:44.956692 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1b751b39-061b-42bb-8685-f063f11d0ff8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:44.963538 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1b751b39-061b-42bb-8685-f063f11d0ff8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:44.964429 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1b751b39-061b-42bb-8685-f063f11d0ff8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:44.965108 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1b751b39-061b-42bb-8685-f063f11d0ff8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:44.966027 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1b751b39-061b-42bb-8685-f063f11d0ff8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:45.199988 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1b751b39-061b-42bb-8685-f063f11d0ff8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:45.208064 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1b751b39-061b-42bb-8685-f063f11d0ff8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.257230 Dec 20 03:30:45.209678 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 143/297] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:44 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:45.354600 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-4b618131-21f3-435a-bf87-275e25e7b099 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:45.355232 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-4b618131-21f3-435a-bf87-275e25e7b099 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:45.365911 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4b618131-21f3-435a-bf87-275e25e7b099 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:45.366371 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4b618131-21f3-435a-bf87-275e25e7b099 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:45.367395 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4b618131-21f3-435a-bf87-275e25e7b099 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:45.369850 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4b618131-21f3-435a-bf87-275e25e7b099 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:45.622166 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-4b618131-21f3-435a-bf87-275e25e7b099 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:45.635574 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-4b618131-21f3-435a-bf87-275e25e7b099 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1321 microversion: 2.1 time: 0.284151 Dec 20 03:30:45.636584 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 155/298] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:45 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:46.226848 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-91c8b6e1-8db5-4c3c-ae9c-e7d374c68223 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:46.227461 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-91c8b6e1-8db5-4c3c-ae9c-e7d374c68223 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:46.234039 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-91c8b6e1-8db5-4c3c-ae9c-e7d374c68223 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:46.234510 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-91c8b6e1-8db5-4c3c-ae9c-e7d374c68223 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:46.235309 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-91c8b6e1-8db5-4c3c-ae9c-e7d374c68223 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:46.235748 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-91c8b6e1-8db5-4c3c-ae9c-e7d374c68223 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:46.421911 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-91c8b6e1-8db5-4c3c-ae9c-e7d374c68223 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:46.437345 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-91c8b6e1-8db5-4c3c-ae9c-e7d374c68223 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.213904 Dec 20 03:30:46.438562 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 144/299] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:46 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:46.658011 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b59ae31b-d5fc-41dc-970c-5fb4d81d47fb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:46.658651 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-b59ae31b-d5fc-41dc-970c-5fb4d81d47fb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:46.665935 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b59ae31b-d5fc-41dc-970c-5fb4d81d47fb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:46.666379 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b59ae31b-d5fc-41dc-970c-5fb4d81d47fb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:46.667167 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b59ae31b-d5fc-41dc-970c-5fb4d81d47fb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:46.667599 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b59ae31b-d5fc-41dc-970c-5fb4d81d47fb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:46.855958 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b59ae31b-d5fc-41dc-970c-5fb4d81d47fb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:46.864034 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b59ae31b-d5fc-41dc-970c-5fb4d81d47fb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1321 microversion: 2.1 time: 0.209820 Dec 20 03:30:46.864593 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 156/300] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:46 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:47.454941 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7e532ffa-ad45-4ae9-8457-679c7c61f04a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:47.455472 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-7e532ffa-ad45-4ae9-8457-679c7c61f04a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:47.462460 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7e532ffa-ad45-4ae9-8457-679c7c61f04a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:47.462910 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7e532ffa-ad45-4ae9-8457-679c7c61f04a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:47.463702 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7e532ffa-ad45-4ae9-8457-679c7c61f04a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:47.464142 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7e532ffa-ad45-4ae9-8457-679c7c61f04a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:47.680899 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7e532ffa-ad45-4ae9-8457-679c7c61f04a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:47.693643 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7e532ffa-ad45-4ae9-8457-679c7c61f04a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.241286 Dec 20 03:30:47.694657 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 145/301] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:47 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:47.882427 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0a6800a6-5a21-431d-a8f7-f52a67c61c97 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:47.883055 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-0a6800a6-5a21-431d-a8f7-f52a67c61c97 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:47.889693 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0a6800a6-5a21-431d-a8f7-f52a67c61c97 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:47.890139 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0a6800a6-5a21-431d-a8f7-f52a67c61c97 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:47.890922 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0a6800a6-5a21-431d-a8f7-f52a67c61c97 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:47.891411 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0a6800a6-5a21-431d-a8f7-f52a67c61c97 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:48.040800 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-0a6800a6-5a21-431d-a8f7-f52a67c61c97 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:48.050096 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-0a6800a6-5a21-431d-a8f7-f52a67c61c97 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1321 microversion: 2.1 time: 0.171563 Dec 20 03:30:48.050726 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 157/302] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:47 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:30:48.722128 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a2f0792e-38c6-42ea-8b0f-8d21aee6f563 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:48.722845 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a2f0792e-38c6-42ea-8b0f-8d21aee6f563 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:48.729098 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a2f0792e-38c6-42ea-8b0f-8d21aee6f563 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:48.729586 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a2f0792e-38c6-42ea-8b0f-8d21aee6f563 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:48.730378 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a2f0792e-38c6-42ea-8b0f-8d21aee6f563 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:48.730816 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a2f0792e-38c6-42ea-8b0f-8d21aee6f563 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:48.885694 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-a2f0792e-38c6-42ea-8b0f-8d21aee6f563 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:48.898220 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a2f0792e-38c6-42ea-8b0f-8d21aee6f563 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.180406 Dec 20 03:30:48.898806 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 146/303] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:48 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:49.067262 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-629d7122-a259-4177-b0eb-53beb7fead5b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:49.067883 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-629d7122-a259-4177-b0eb-53beb7fead5b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:49.074712 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-629d7122-a259-4177-b0eb-53beb7fead5b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:49.075149 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-629d7122-a259-4177-b0eb-53beb7fead5b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:49.076237 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-629d7122-a259-4177-b0eb-53beb7fead5b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:49.076666 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-629d7122-a259-4177-b0eb-53beb7fead5b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:49.233964 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-629d7122-a259-4177-b0eb-53beb7fead5b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:49.242942 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-629d7122-a259-4177-b0eb-53beb7fead5b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1321 microversion: 2.1 time: 0.179107 Dec 20 03:30:49.243769 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 158/304] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:49 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:49.915861 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a5658dd6-1c1c-41d5-828b-84cf73632761 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:49.916523 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a5658dd6-1c1c-41d5-828b-84cf73632761 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:49.922978 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a5658dd6-1c1c-41d5-828b-84cf73632761 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:49.923417 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a5658dd6-1c1c-41d5-828b-84cf73632761 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:49.924227 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a5658dd6-1c1c-41d5-828b-84cf73632761 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:49.925976 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a5658dd6-1c1c-41d5-828b-84cf73632761 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:50.084858 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-a5658dd6-1c1c-41d5-828b-84cf73632761 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:50.099048 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a5658dd6-1c1c-41d5-828b-84cf73632761 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.184666 Dec 20 03:30:50.100588 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 147/305] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:49 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:30:50.133095 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-1a61106f-6ccf-426a-8f64-143cdc3614fe req-f1338102-c1ed-468a-b561-77ac93a8a8bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac8535fe-2f8e-4681-a5ba-7d6ee956b779", "name": "network-vif-plugged", "status": "completed", "tag": "176ceebe-9cae-40dc-8342-df2cb17a5f92"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:50.134742 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:30:50.134742 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:30:50.144269 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-1a61106f-6ccf-426a-8f64-143cdc3614fe req-f1338102-c1ed-468a-b561-77ac93a8a8bf service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:50.145152 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-1a61106f-6ccf-426a-8f64-143cdc3614fe req-f1338102-c1ed-468a-b561-77ac93a8a8bf service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:50.156065 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-1a61106f-6ccf-426a-8f64-143cdc3614fe req-f1338102-c1ed-468a-b561-77ac93a8a8bf service nova] Creating event network-vif-plugged:176ceebe-9cae-40dc-8342-df2cb17a5f92 for instance ac8535fe-2f8e-4681-a5ba-7d6ee956b779 on hv-cinder-81803 Dec 20 03:30:50.162019 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-1a61106f-6ccf-426a-8f64-143cdc3614fe req-f1338102-c1ed-468a-b561-77ac93a8a8bf service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033022 Dec 20 03:30:50.162613 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 159/306] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:30:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:30:50.260848 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-cdf2943d-51f3-46ab-9399-2723b6a50876 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:50.261846 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-cdf2943d-51f3-46ab-9399-2723b6a50876 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:50.269221 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cdf2943d-51f3-46ab-9399-2723b6a50876 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:50.269843 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cdf2943d-51f3-46ab-9399-2723b6a50876 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:50.270669 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cdf2943d-51f3-46ab-9399-2723b6a50876 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:50.271108 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cdf2943d-51f3-46ab-9399-2723b6a50876 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:50.445444 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-cdf2943d-51f3-46ab-9399-2723b6a50876 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:50.456748 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-cdf2943d-51f3-46ab-9399-2723b6a50876 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1321 microversion: 2.1 time: 0.199130 Dec 20 03:30:50.466727 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 148/307] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:50 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:30:51.119448 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d43c659c-3b11-4efb-a6e3-a4304295f5b3 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:51.120500 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d43c659c-3b11-4efb-a6e3-a4304295f5b3 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:51.130530 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d43c659c-3b11-4efb-a6e3-a4304295f5b3 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:51.133213 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d43c659c-3b11-4efb-a6e3-a4304295f5b3 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:51.133213 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d43c659c-3b11-4efb-a6e3-a4304295f5b3 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:51.133213 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d43c659c-3b11-4efb-a6e3-a4304295f5b3 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:51.268749 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d43c659c-3b11-4efb-a6e3-a4304295f5b3 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:51.277437 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d43c659c-3b11-4efb-a6e3-a4304295f5b3 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.161959 Dec 20 03:30:51.282416 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 160/308] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:51 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:51.474889 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-82fbdb18-2626-4d6c-9c44-6b6fb04aa530 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:51.475758 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-82fbdb18-2626-4d6c-9c44-6b6fb04aa530 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:51.482184 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-82fbdb18-2626-4d6c-9c44-6b6fb04aa530 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:51.482633 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-82fbdb18-2626-4d6c-9c44-6b6fb04aa530 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:51.483458 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-82fbdb18-2626-4d6c-9c44-6b6fb04aa530 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:51.483891 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-82fbdb18-2626-4d6c-9c44-6b6fb04aa530 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:51.665925 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-82fbdb18-2626-4d6c-9c44-6b6fb04aa530 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:51.687712 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-82fbdb18-2626-4d6c-9c44-6b6fb04aa530 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1321 microversion: 2.1 time: 0.217259 Dec 20 03:30:51.688305 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 149/309] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:51 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:30:52.295931 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-c5da621f-03ed-4d8c-9fa7-869c0001c85c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:52.300945 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-c5da621f-03ed-4d8c-9fa7-869c0001c85c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:52.304480 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c5da621f-03ed-4d8c-9fa7-869c0001c85c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:52.304926 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c5da621f-03ed-4d8c-9fa7-869c0001c85c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:52.305902 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c5da621f-03ed-4d8c-9fa7-869c0001c85c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:52.306382 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c5da621f-03ed-4d8c-9fa7-869c0001c85c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:52.457456 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-c5da621f-03ed-4d8c-9fa7-869c0001c85c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:52.465922 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-c5da621f-03ed-4d8c-9fa7-869c0001c85c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.173533 Dec 20 03:30:52.467304 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 161/310] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:52 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:52.704002 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-3cb06da8-13a2-4780-8818-bd4692bc6e21 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:52.704599 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-3cb06da8-13a2-4780-8818-bd4692bc6e21 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:52.711199 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3cb06da8-13a2-4780-8818-bd4692bc6e21 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:52.712015 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3cb06da8-13a2-4780-8818-bd4692bc6e21 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:52.712756 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3cb06da8-13a2-4780-8818-bd4692bc6e21 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:52.713232 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3cb06da8-13a2-4780-8818-bd4692bc6e21 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:52.850025 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-3cb06da8-13a2-4780-8818-bd4692bc6e21 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:52.859796 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-3cb06da8-13a2-4780-8818-bd4692bc6e21 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1321 microversion: 2.1 time: 0.159827 Dec 20 03:30:52.860373 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 150/311] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:52 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:53.483366 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-931c42c4-99d9-4211-83f4-65c5a122b594 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:53.483966 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-931c42c4-99d9-4211-83f4-65c5a122b594 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:53.490602 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-931c42c4-99d9-4211-83f4-65c5a122b594 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:53.491056 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-931c42c4-99d9-4211-83f4-65c5a122b594 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:53.491875 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-931c42c4-99d9-4211-83f4-65c5a122b594 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:53.492310 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-931c42c4-99d9-4211-83f4-65c5a122b594 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:53.630267 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-931c42c4-99d9-4211-83f4-65c5a122b594 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:53.639752 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-931c42c4-99d9-4211-83f4-65c5a122b594 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.159278 Dec 20 03:30:53.640785 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 162/312] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:53 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:53.876969 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-2526249d-dbf9-4e2a-add0-771d976ef780 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:53.878187 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-2526249d-dbf9-4e2a-add0-771d976ef780 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:53.884730 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2526249d-dbf9-4e2a-add0-771d976ef780 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:53.885220 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2526249d-dbf9-4e2a-add0-771d976ef780 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:53.886064 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2526249d-dbf9-4e2a-add0-771d976ef780 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:53.886519 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2526249d-dbf9-4e2a-add0-771d976ef780 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:54.029876 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-2526249d-dbf9-4e2a-add0-771d976ef780 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:54.039395 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-2526249d-dbf9-4e2a-add0-771d976ef780 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1321 microversion: 2.1 time: 0.165967 Dec 20 03:30:54.039977 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 151/313] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:53 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:54.659563 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-98c0faf8-5e64-4fa8-9448-81f16198a431 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:54.675187 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-98c0faf8-5e64-4fa8-9448-81f16198a431 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:54.675187 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-98c0faf8-5e64-4fa8-9448-81f16198a431 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:54.675187 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-98c0faf8-5e64-4fa8-9448-81f16198a431 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:54.675187 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-98c0faf8-5e64-4fa8-9448-81f16198a431 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:54.676058 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-98c0faf8-5e64-4fa8-9448-81f16198a431 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:54.833263 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-98c0faf8-5e64-4fa8-9448-81f16198a431 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:54.843510 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-98c0faf8-5e64-4fa8-9448-81f16198a431 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.187856 Dec 20 03:30:54.844547 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 163/314] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:54 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:55.056789 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-032aea78-4b92-43a6-95d1-98085ba1121b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:55.057416 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-032aea78-4b92-43a6-95d1-98085ba1121b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:55.064236 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-032aea78-4b92-43a6-95d1-98085ba1121b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:55.064696 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-032aea78-4b92-43a6-95d1-98085ba1121b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:55.065524 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-032aea78-4b92-43a6-95d1-98085ba1121b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:55.065967 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-032aea78-4b92-43a6-95d1-98085ba1121b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:55.232247 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-032aea78-4b92-43a6-95d1-98085ba1121b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:55.241066 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-032aea78-4b92-43a6-95d1-98085ba1121b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1515 microversion: 2.1 time: 0.187890 Dec 20 03:30:55.241782 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 152/315] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:55 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:55.258717 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-2a5aa799-8f4d-4e43-82bf-120c2c95324c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:55.260007 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-2a5aa799-8f4d-4e43-82bf-120c2c95324c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:55.269198 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2a5aa799-8f4d-4e43-82bf-120c2c95324c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:55.270368 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2a5aa799-8f4d-4e43-82bf-120c2c95324c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:55.271585 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2a5aa799-8f4d-4e43-82bf-120c2c95324c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:55.274014 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2a5aa799-8f4d-4e43-82bf-120c2c95324c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:55.302673 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.objects.instance [None req-2a5aa799-8f4d-4e43-82bf-120c2c95324c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lazy-loading 'flavor' on Instance uuid ac8535fe-2f8e-4681-a5ba-7d6ee956b779 {{(pid=117011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:30:55.687270 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-2a5aa799-8f4d-4e43-82bf-120c2c95324c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "POST /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779/action" status: 200 len: 32 microversion: 2.1 time: 0.432194 Dec 20 03:30:55.688079 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 164/316] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:30:55 2021] POST /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779/action => generated 32 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 03:30:55.697106 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-88809e22-a95c-4a60-a6f3-fa63e18108b9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:55.697834 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-88809e22-a95c-4a60-a6f3-fa63e18108b9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:55.704098 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-88809e22-a95c-4a60-a6f3-fa63e18108b9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:55.704546 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-88809e22-a95c-4a60-a6f3-fa63e18108b9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:55.705370 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-88809e22-a95c-4a60-a6f3-fa63e18108b9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:55.706451 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-88809e22-a95c-4a60-a6f3-fa63e18108b9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:55.862333 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-8b90097d-bce8-43ab-9e2f-c6a206a5c56b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:55.863062 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-8b90097d-bce8-43ab-9e2f-c6a206a5c56b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:55.872597 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8b90097d-bce8-43ab-9e2f-c6a206a5c56b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:55.873055 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8b90097d-bce8-43ab-9e2f-c6a206a5c56b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:55.873902 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8b90097d-bce8-43ab-9e2f-c6a206a5c56b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:55.874349 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8b90097d-bce8-43ab-9e2f-c6a206a5c56b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:55.885045 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-88809e22-a95c-4a60-a6f3-fa63e18108b9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:55.895826 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-88809e22-a95c-4a60-a6f3-fa63e18108b9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.202058 Dec 20 03:30:55.899386 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 153/317] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:55 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:56.141862 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-8b90097d-bce8-43ab-9e2f-c6a206a5c56b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:56.155443 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-8b90097d-bce8-43ab-9e2f-c6a206a5c56b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.297168 Dec 20 03:30:56.156043 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 165/318] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:55 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:30:56.918929 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ee5e89b3-aea1-442a-90dd-8e6afb334771 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:56.918929 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ee5e89b3-aea1-442a-90dd-8e6afb334771 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:56.922323 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ee5e89b3-aea1-442a-90dd-8e6afb334771 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:56.922777 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ee5e89b3-aea1-442a-90dd-8e6afb334771 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:56.923566 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ee5e89b3-aea1-442a-90dd-8e6afb334771 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:56.924206 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ee5e89b3-aea1-442a-90dd-8e6afb334771 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:56.925771 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1212516b-49d9-482f-a54b-d1fb0eda9f2e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5cede403-2f14-41d8-bb2f-126b749ec98d"}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:30:56.930030 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1212516b-49d9-482f-a54b-d1fb0eda9f2e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:56.938573 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1212516b-49d9-482f-a54b-d1fb0eda9f2e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:56.939596 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1212516b-49d9-482f-a54b-d1fb0eda9f2e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:56.941193 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1212516b-49d9-482f-a54b-d1fb0eda9f2e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:56.944231 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1212516b-49d9-482f-a54b-d1fb0eda9f2e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:57.060027 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-1212516b-49d9-482f-a54b-d1fb0eda9f2e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] HTTP exception thrown: Invalid volume: volume 5cede403-2f14-41d8-bb2f-126b749ec98d is already attached to instances: 69cdeced-dc70-4b1b-826b-fc1e794fff2b Dec 20 03:30:57.060810 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1212516b-49d9-482f-a54b-d1fb0eda9f2e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Returning 400 to user: Invalid volume: volume 5cede403-2f14-41d8-bb2f-126b749ec98d is already attached to instances: 69cdeced-dc70-4b1b-826b-fc1e794fff2b {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:30:57.061683 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1212516b-49d9-482f-a54b-d1fb0eda9f2e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "POST /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.140556 Dec 20 03:30:57.062328 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 166/319] 10.222.0.53 () {60 vars in 1322 bytes} [Mon Dec 20 03:30:56 2021] POST /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b/os-volume_attachments => generated 174 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 20 03:30:57.116445 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-ee5e89b3-aea1-442a-90dd-8e6afb334771 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:57.122405 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ee5e89b3-aea1-442a-90dd-8e6afb334771 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.211092 Dec 20 03:30:57.122983 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 154/320] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:56 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:57.141624 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-87b0bded-cdfe-40de-94d5-9c84959482a8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:57.142120 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-87b0bded-cdfe-40de-94d5-9c84959482a8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:57.148584 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-87b0bded-cdfe-40de-94d5-9c84959482a8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:57.149101 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-87b0bded-cdfe-40de-94d5-9c84959482a8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:57.149923 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-87b0bded-cdfe-40de-94d5-9c84959482a8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:57.150351 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-87b0bded-cdfe-40de-94d5-9c84959482a8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:57.174221 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-af8e9a1b-d999-41c0-a014-b178c7ef7c86 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:57.175550 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-af8e9a1b-d999-41c0-a014-b178c7ef7c86 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:57.181866 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-af8e9a1b-d999-41c0-a014-b178c7ef7c86 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:57.191017 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-af8e9a1b-d999-41c0-a014-b178c7ef7c86 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:57.191017 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-af8e9a1b-d999-41c0-a014-b178c7ef7c86 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:57.191017 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-af8e9a1b-d999-41c0-a014-b178c7ef7c86 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:57.285351 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.objects.instance [None req-87b0bded-cdfe-40de-94d5-9c84959482a8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lazy-loading 'services' on Instance uuid 69cdeced-dc70-4b1b-826b-fc1e794fff2b {{(pid=117011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:30:57.335698 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-af8e9a1b-d999-41c0-a014-b178c7ef7c86 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:57.351684 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-af8e9a1b-d999-41c0-a014-b178c7ef7c86 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.180840 Dec 20 03:30:57.361028 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 155/321] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:57 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:30:57.637345 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-87b0bded-cdfe-40de-94d5-9c84959482a8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "DELETE /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b/os-volume_attachments/5cede403-2f14-41d8-bb2f-126b749ec98d" status: 202 len: 0 microversion: 2.1 time: 0.501678 Dec 20 03:30:57.638263 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 167/322] 10.222.0.53 () {58 vars in 1415 bytes} [Mon Dec 20 03:30:57 2021] DELETE /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b/os-volume_attachments/5cede403-2f14-41d8-bb2f-126b749ec98d => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:30:57.647756 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-2cb5756c-fd0a-484a-8ed0-444513ac9a9f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:57.648762 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-2cb5756c-fd0a-484a-8ed0-444513ac9a9f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:57.654881 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2cb5756c-fd0a-484a-8ed0-444513ac9a9f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:57.655423 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2cb5756c-fd0a-484a-8ed0-444513ac9a9f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:57.656209 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2cb5756c-fd0a-484a-8ed0-444513ac9a9f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:57.656643 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2cb5756c-fd0a-484a-8ed0-444513ac9a9f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:57.687352 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-2cb5756c-fd0a-484a-8ed0-444513ac9a9f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044517 Dec 20 03:30:57.687906 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 156/323] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:30:57 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:30:58.141196 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-eef0fce4-f2b4-4b0d-b6c0-9f3782fc58b1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:58.141992 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-eef0fce4-f2b4-4b0d-b6c0-9f3782fc58b1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:58.149412 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eef0fce4-f2b4-4b0d-b6c0-9f3782fc58b1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:58.149889 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eef0fce4-f2b4-4b0d-b6c0-9f3782fc58b1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:58.150930 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eef0fce4-f2b4-4b0d-b6c0-9f3782fc58b1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:58.151361 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eef0fce4-f2b4-4b0d-b6c0-9f3782fc58b1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:58.296392 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-eef0fce4-f2b4-4b0d-b6c0-9f3782fc58b1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:58.305225 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-eef0fce4-f2b4-4b0d-b6c0-9f3782fc58b1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.168995 Dec 20 03:30:58.305790 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 168/324] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:58 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:30:58.369472 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7950f513-d92b-4f60-bc97-9247c6267ab2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:58.370088 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-7950f513-d92b-4f60-bc97-9247c6267ab2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:58.376760 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7950f513-d92b-4f60-bc97-9247c6267ab2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:58.377286 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7950f513-d92b-4f60-bc97-9247c6267ab2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:58.378333 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7950f513-d92b-4f60-bc97-9247c6267ab2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:58.378868 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7950f513-d92b-4f60-bc97-9247c6267ab2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:58.541316 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7950f513-d92b-4f60-bc97-9247c6267ab2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:58.549820 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7950f513-d92b-4f60-bc97-9247c6267ab2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.183966 Dec 20 03:30:58.550303 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 157/325] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:58 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:58.699677 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-73858991-c2c0-45db-ad0b-e2659bbc5bd0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:58.700779 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-73858991-c2c0-45db-ad0b-e2659bbc5bd0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:58.708867 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-73858991-c2c0-45db-ad0b-e2659bbc5bd0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:58.709349 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-73858991-c2c0-45db-ad0b-e2659bbc5bd0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:58.710146 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-73858991-c2c0-45db-ad0b-e2659bbc5bd0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:58.710577 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-73858991-c2c0-45db-ad0b-e2659bbc5bd0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:58.755549 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-73858991-c2c0-45db-ad0b-e2659bbc5bd0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059648 Dec 20 03:30:58.756137 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 169/326] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:30:58 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:30:59.322541 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-831b8735-d958-4b6c-aa3b-0cb48119ba54 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:59.323153 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-831b8735-d958-4b6c-aa3b-0cb48119ba54 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:59.329612 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-831b8735-d958-4b6c-aa3b-0cb48119ba54 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:59.330056 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-831b8735-d958-4b6c-aa3b-0cb48119ba54 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:59.330845 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-831b8735-d958-4b6c-aa3b-0cb48119ba54 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:59.331275 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-831b8735-d958-4b6c-aa3b-0cb48119ba54 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:59.477755 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-831b8735-d958-4b6c-aa3b-0cb48119ba54 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:59.485592 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-831b8735-d958-4b6c-aa3b-0cb48119ba54 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.166750 Dec 20 03:30:59.486227 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 158/327] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:59 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:59.568256 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-766bdeb5-818e-4737-ae3a-8bec55726dcd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:59.569263 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-766bdeb5-818e-4737-ae3a-8bec55726dcd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:59.576132 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-766bdeb5-818e-4737-ae3a-8bec55726dcd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:59.576587 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-766bdeb5-818e-4737-ae3a-8bec55726dcd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:59.577408 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-766bdeb5-818e-4737-ae3a-8bec55726dcd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:59.577848 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-766bdeb5-818e-4737-ae3a-8bec55726dcd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:59.717862 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-766bdeb5-818e-4737-ae3a-8bec55726dcd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:30:59.726340 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-766bdeb5-818e-4737-ae3a-8bec55726dcd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.162607 Dec 20 03:30:59.726923 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 170/328] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:30:59 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:30:59.767049 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-20ad995e-42f2-4e1d-9455-2b057505144a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:30:59.768273 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-20ad995e-42f2-4e1d-9455-2b057505144a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:30:59.775397 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-20ad995e-42f2-4e1d-9455-2b057505144a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:59.775917 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-20ad995e-42f2-4e1d-9455-2b057505144a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:59.776773 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-20ad995e-42f2-4e1d-9455-2b057505144a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:30:59.777322 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-20ad995e-42f2-4e1d-9455-2b057505144a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:30:59.818418 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-20ad995e-42f2-4e1d-9455-2b057505144a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055165 Dec 20 03:30:59.821191 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 159/329] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:30:59 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:31:00.502542 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-fba22f2c-8f4d-4030-97b8-434d78a7cca0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:00.503110 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-fba22f2c-8f4d-4030-97b8-434d78a7cca0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:00.509663 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fba22f2c-8f4d-4030-97b8-434d78a7cca0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:00.510146 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fba22f2c-8f4d-4030-97b8-434d78a7cca0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:00.511031 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fba22f2c-8f4d-4030-97b8-434d78a7cca0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:00.511479 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fba22f2c-8f4d-4030-97b8-434d78a7cca0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:00.666408 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-fba22f2c-8f4d-4030-97b8-434d78a7cca0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:00.675640 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-fba22f2c-8f4d-4030-97b8-434d78a7cca0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.176744 Dec 20 03:31:00.676222 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 171/330] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:00 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:00.743764 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-30227ca7-23cd-4446-b294-d6809e8ecd3c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:00.744407 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-30227ca7-23cd-4446-b294-d6809e8ecd3c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:00.751546 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-30227ca7-23cd-4446-b294-d6809e8ecd3c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:00.751999 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-30227ca7-23cd-4446-b294-d6809e8ecd3c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:00.752892 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-30227ca7-23cd-4446-b294-d6809e8ecd3c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:00.753309 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-30227ca7-23cd-4446-b294-d6809e8ecd3c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:00.833914 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-bf15b7d0-0e0c-49c7-893d-a323628cea8c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:00.836373 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-bf15b7d0-0e0c-49c7-893d-a323628cea8c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:00.850143 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bf15b7d0-0e0c-49c7-893d-a323628cea8c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:00.851349 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bf15b7d0-0e0c-49c7-893d-a323628cea8c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:00.853724 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bf15b7d0-0e0c-49c7-893d-a323628cea8c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:00.854288 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bf15b7d0-0e0c-49c7-893d-a323628cea8c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:00.928180 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-bf15b7d0-0e0c-49c7-893d-a323628cea8c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101760 Dec 20 03:31:00.928850 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 172/331] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:31:00 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:31:00.969810 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-30227ca7-23cd-4446-b294-d6809e8ecd3c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:00.981030 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-30227ca7-23cd-4446-b294-d6809e8ecd3c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.239954 Dec 20 03:31:00.981030 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 160/332] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:00 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:01.693289 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e631ff80-e6e2-46fc-942c-831966e92feb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:01.698484 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e631ff80-e6e2-46fc-942c-831966e92feb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:01.700757 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e631ff80-e6e2-46fc-942c-831966e92feb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:01.701252 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e631ff80-e6e2-46fc-942c-831966e92feb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:01.702227 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e631ff80-e6e2-46fc-942c-831966e92feb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:01.702513 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e631ff80-e6e2-46fc-942c-831966e92feb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:01.894034 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-e631ff80-e6e2-46fc-942c-831966e92feb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:01.915425 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e631ff80-e6e2-46fc-942c-831966e92feb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.226038 Dec 20 03:31:01.916226 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 173/333] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:01 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:01.941187 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1880b27c-a8b7-4a5a-9849-cc97afbb115d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:01.942638 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1880b27c-a8b7-4a5a-9849-cc97afbb115d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:01.949982 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1880b27c-a8b7-4a5a-9849-cc97afbb115d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:01.950645 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1880b27c-a8b7-4a5a-9849-cc97afbb115d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:01.951432 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1880b27c-a8b7-4a5a-9849-cc97afbb115d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:01.952019 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1880b27c-a8b7-4a5a-9849-cc97afbb115d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:01.998718 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-3ddcecc5-b85a-47cc-950e-60b906990e09 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:02.002826 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-3ddcecc5-b85a-47cc-950e-60b906990e09 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:02.004009 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1880b27c-a8b7-4a5a-9849-cc97afbb115d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066357 Dec 20 03:31:02.007273 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 161/334] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:31:01 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 03:31:02.010803 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3ddcecc5-b85a-47cc-950e-60b906990e09 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:02.011402 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3ddcecc5-b85a-47cc-950e-60b906990e09 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:02.012276 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3ddcecc5-b85a-47cc-950e-60b906990e09 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:02.013176 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3ddcecc5-b85a-47cc-950e-60b906990e09 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:02.201953 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-3ddcecc5-b85a-47cc-950e-60b906990e09 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:02.211418 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-3ddcecc5-b85a-47cc-950e-60b906990e09 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.218730 Dec 20 03:31:02.212016 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 174/335] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:01 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:02.805293 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d6d541eb-0cf6-487d-8a7f-87bbc7329b19 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2058417602", "imageRef": "9c4ec443-915b-4997-82d3-08cc97ba635b", "flavorRef": "452", "networks": [{"uuid": "81fcedcc-7077-48be-86e2-d027fe8cf5ab"}]}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:31:02.867078 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.network.neutron [None req-d6d541eb-0cf6-487d-8a7f-87bbc7329b19 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] validate_networks() for [('81fcedcc-7077-48be-86e2-d027fe8cf5ab', None, None, None, None, None)] {{(pid=117012) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:31:02.940529 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-3b6c1f69-aa2f-426a-bab1-5d2751d0f991 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:02.941604 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-3b6c1f69-aa2f-426a-bab1-5d2751d0f991 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:02.950102 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3b6c1f69-aa2f-426a-bab1-5d2751d0f991 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:02.950695 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3b6c1f69-aa2f-426a-bab1-5d2751d0f991 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:02.951789 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3b6c1f69-aa2f-426a-bab1-5d2751d0f991 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:02.952341 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3b6c1f69-aa2f-426a-bab1-5d2751d0f991 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:03.166098 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-3b6c1f69-aa2f-426a-bab1-5d2751d0f991 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:03.174197 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-3b6c1f69-aa2f-426a-bab1-5d2751d0f991 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.238221 Dec 20 03:31:03.177204 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 175/336] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:02 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:03.229437 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-08128969-8b05-4434-a6f2-54f0b8c0be66 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:03.230260 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-08128969-8b05-4434-a6f2-54f0b8c0be66 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:03.237344 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-08128969-8b05-4434-a6f2-54f0b8c0be66 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:03.237344 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-08128969-8b05-4434-a6f2-54f0b8c0be66 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:03.237937 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-08128969-8b05-4434-a6f2-54f0b8c0be66 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:03.238373 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-08128969-8b05-4434-a6f2-54f0b8c0be66 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:03.330600 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-d6d541eb-0cf6-487d-8a7f-87bbc7329b19 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Flavor limits 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:31:03.331207 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-d6d541eb-0cf6-487d-8a7f-87bbc7329b19 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Image limits 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:31:03.331602 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-d6d541eb-0cf6-487d-8a7f-87bbc7329b19 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Flavor pref 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:31:03.332034 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-d6d541eb-0cf6-487d-8a7f-87bbc7329b19 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Image pref 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:31:03.332492 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-d6d541eb-0cf6-487d-8a7f-87bbc7329b19 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:31:03.344487 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d6d541eb-0cf6-487d-8a7f-87bbc7329b19 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:03.344946 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d6d541eb-0cf6-487d-8a7f-87bbc7329b19 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:03.345893 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d6d541eb-0cf6-487d-8a7f-87bbc7329b19 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:03.346328 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d6d541eb-0cf6-487d-8a7f-87bbc7329b19 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:03.365936 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-d6d541eb-0cf6-487d-8a7f-87bbc7329b19 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Getting quotas for project 032e3b59ca34420bbb5bdcaaa1cbb72b. Resources: {'instances', 'ram', 'cores'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:31:03.376094 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-d6d541eb-0cf6-487d-8a7f-87bbc7329b19 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Getting quotas for user b9dcbac34c544fdea6152f710ab3d521 and project 032e3b59ca34420bbb5bdcaaa1cbb72b. Resources: {'instances', 'ram', 'cores'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:31:03.398633 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d6d541eb-0cf6-487d-8a7f-87bbc7329b19 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Going to run 1 instances... {{(pid=117012) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:31:03.403780 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d6d541eb-0cf6-487d-8a7f-87bbc7329b19 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c4ec443-915b-4997-82d3-08cc97ba635b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117012) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:31:03.404497 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-08128969-8b05-4434-a6f2-54f0b8c0be66 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:03.413121 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-08128969-8b05-4434-a6f2-54f0b8c0be66 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.188031 Dec 20 03:31:03.413737 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 176/337] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:03 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:03.582253 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d6d541eb-0cf6-487d-8a7f-87bbc7329b19 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.781788 Dec 20 03:31:03.583929 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 162/338] 10.222.0.53 () {60 vars in 1146 bytes} [Mon Dec 20 03:31:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 03:31:03.593537 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-24d9fcbe-92df-4d60-a71e-328c3cf42928 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:03.594152 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-24d9fcbe-92df-4d60-a71e-328c3cf42928 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:03.651263 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-24d9fcbe-92df-4d60-a71e-328c3cf42928 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:03.659088 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-24d9fcbe-92df-4d60-a71e-328c3cf42928 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1218 microversion: 2.1 time: 0.069122 Dec 20 03:31:03.659676 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 177/339] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:03 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:04.199740 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-842dc245-517d-4c48-a34e-2c5c830509be tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:04.201124 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-842dc245-517d-4c48-a34e-2c5c830509be tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:04.210628 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-842dc245-517d-4c48-a34e-2c5c830509be tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:04.211218 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-842dc245-517d-4c48-a34e-2c5c830509be tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:04.212510 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-842dc245-517d-4c48-a34e-2c5c830509be tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:04.213284 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-842dc245-517d-4c48-a34e-2c5c830509be tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:04.369340 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-842dc245-517d-4c48-a34e-2c5c830509be tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:04.379115 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-842dc245-517d-4c48-a34e-2c5c830509be tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.186946 Dec 20 03:31:04.380637 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 163/340] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:04 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:04.432289 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-28fcd7ce-155b-452c-918e-4e014f51b6ca tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:04.432994 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-28fcd7ce-155b-452c-918e-4e014f51b6ca tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:04.442652 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-28fcd7ce-155b-452c-918e-4e014f51b6ca tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:04.443286 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-28fcd7ce-155b-452c-918e-4e014f51b6ca tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:04.444218 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-28fcd7ce-155b-452c-918e-4e014f51b6ca tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:04.444728 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-28fcd7ce-155b-452c-918e-4e014f51b6ca tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:04.611056 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-28fcd7ce-155b-452c-918e-4e014f51b6ca tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:04.626814 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-28fcd7ce-155b-452c-918e-4e014f51b6ca tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.200790 Dec 20 03:31:04.629127 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 178/341] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:04 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:04.681952 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-0aff8ca7-2ce7-4f8f-bae0-385e3c7e3da6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:04.682693 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-0aff8ca7-2ce7-4f8f-bae0-385e3c7e3da6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:04.689567 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0aff8ca7-2ce7-4f8f-bae0-385e3c7e3da6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:04.690025 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0aff8ca7-2ce7-4f8f-bae0-385e3c7e3da6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:04.690831 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0aff8ca7-2ce7-4f8f-bae0-385e3c7e3da6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:04.691305 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0aff8ca7-2ce7-4f8f-bae0-385e3c7e3da6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:04.942429 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0aff8ca7-2ce7-4f8f-bae0-385e3c7e3da6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:04.953901 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-0aff8ca7-2ce7-4f8f-bae0-385e3c7e3da6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1222 microversion: 2.1 time: 0.279060 Dec 20 03:31:04.954799 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 164/342] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:04 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1222 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:05.396335 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a15f58d6-80ee-47b5-bd74-8a209345f1c7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:05.397101 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a15f58d6-80ee-47b5-bd74-8a209345f1c7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:05.404298 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a15f58d6-80ee-47b5-bd74-8a209345f1c7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:05.404803 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a15f58d6-80ee-47b5-bd74-8a209345f1c7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:05.405871 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a15f58d6-80ee-47b5-bd74-8a209345f1c7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:05.406390 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a15f58d6-80ee-47b5-bd74-8a209345f1c7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:05.567226 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-a15f58d6-80ee-47b5-bd74-8a209345f1c7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:05.575600 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a15f58d6-80ee-47b5-bd74-8a209345f1c7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.182836 Dec 20 03:31:05.576707 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 179/343] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:05 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:05.644878 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1cb79cf5-1e3c-45f5-b535-88b51f9bb6da tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:05.646592 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1cb79cf5-1e3c-45f5-b535-88b51f9bb6da tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:05.653678 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1cb79cf5-1e3c-45f5-b535-88b51f9bb6da tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:05.654428 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1cb79cf5-1e3c-45f5-b535-88b51f9bb6da tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:05.655247 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1cb79cf5-1e3c-45f5-b535-88b51f9bb6da tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:05.655729 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1cb79cf5-1e3c-45f5-b535-88b51f9bb6da tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:05.840319 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1cb79cf5-1e3c-45f5-b535-88b51f9bb6da tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:05.849709 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1cb79cf5-1e3c-45f5-b535-88b51f9bb6da tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.208606 Dec 20 03:31:05.850309 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 165/344] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:05 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:05.979841 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a5590dfb-a0e4-45cf-8516-32dcf064dc87 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:05.981079 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a5590dfb-a0e4-45cf-8516-32dcf064dc87 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:05.991288 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a5590dfb-a0e4-45cf-8516-32dcf064dc87 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:05.992138 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a5590dfb-a0e4-45cf-8516-32dcf064dc87 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:05.993168 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a5590dfb-a0e4-45cf-8516-32dcf064dc87 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:05.994017 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a5590dfb-a0e4-45cf-8516-32dcf064dc87 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:06.246507 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-a5590dfb-a0e4-45cf-8516-32dcf064dc87 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:06.257082 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a5590dfb-a0e4-45cf-8516-32dcf064dc87 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1222 microversion: 2.1 time: 0.285105 Dec 20 03:31:06.257972 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 180/345] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:05 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1222 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:06.593064 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a82292c8-37a6-496d-8b75-897d7162cce1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:06.593836 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a82292c8-37a6-496d-8b75-897d7162cce1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:06.600670 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a82292c8-37a6-496d-8b75-897d7162cce1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:06.601128 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a82292c8-37a6-496d-8b75-897d7162cce1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:06.601946 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a82292c8-37a6-496d-8b75-897d7162cce1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:06.602386 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a82292c8-37a6-496d-8b75-897d7162cce1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:06.778799 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-a82292c8-37a6-496d-8b75-897d7162cce1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:06.786536 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a82292c8-37a6-496d-8b75-897d7162cce1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.197102 Dec 20 03:31:06.787306 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 166/346] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:06 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:06.869327 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-7bb40da7-53ef-48f2-a888-2c099e2e0a53 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:06.872251 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-7bb40da7-53ef-48f2-a888-2c099e2e0a53 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:06.882180 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7bb40da7-53ef-48f2-a888-2c099e2e0a53 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:06.884317 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7bb40da7-53ef-48f2-a888-2c099e2e0a53 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:06.885755 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7bb40da7-53ef-48f2-a888-2c099e2e0a53 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:06.886559 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7bb40da7-53ef-48f2-a888-2c099e2e0a53 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:07.160222 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-7bb40da7-53ef-48f2-a888-2c099e2e0a53 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:07.174444 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-7bb40da7-53ef-48f2-a888-2c099e2e0a53 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1724 microversion: 2.1 time: 0.311334 Dec 20 03:31:07.181770 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 181/347] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:06 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1724 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:07.275369 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-052f8cbc-7a88-47b2-bccc-1ed696d8b65a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:07.275982 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-052f8cbc-7a88-47b2-bccc-1ed696d8b65a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:07.295288 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-052f8cbc-7a88-47b2-bccc-1ed696d8b65a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:07.296021 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-052f8cbc-7a88-47b2-bccc-1ed696d8b65a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:07.297101 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-052f8cbc-7a88-47b2-bccc-1ed696d8b65a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:07.298174 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-052f8cbc-7a88-47b2-bccc-1ed696d8b65a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:07.407717 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-052f8cbc-7a88-47b2-bccc-1ed696d8b65a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:07.416151 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-052f8cbc-7a88-47b2-bccc-1ed696d8b65a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1214 microversion: 2.1 time: 0.144792 Dec 20 03:31:07.417899 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 167/348] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:07 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:07.812672 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-049e0b7c-87c6-40a5-860c-77c4c3bc9d65 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:07.813367 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-049e0b7c-87c6-40a5-860c-77c4c3bc9d65 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:07.821059 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-049e0b7c-87c6-40a5-860c-77c4c3bc9d65 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:07.821556 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-049e0b7c-87c6-40a5-860c-77c4c3bc9d65 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:07.822376 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-049e0b7c-87c6-40a5-860c-77c4c3bc9d65 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:07.822847 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-049e0b7c-87c6-40a5-860c-77c4c3bc9d65 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:07.970390 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-049e0b7c-87c6-40a5-860c-77c4c3bc9d65 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:07.978932 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-049e0b7c-87c6-40a5-860c-77c4c3bc9d65 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.170515 Dec 20 03:31:07.981849 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 182/349] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:07 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:08.191719 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-5183695f-7b9c-4376-b322-c788ec26b990 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:08.192470 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-5183695f-7b9c-4376-b322-c788ec26b990 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:08.198999 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5183695f-7b9c-4376-b322-c788ec26b990 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:08.199476 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5183695f-7b9c-4376-b322-c788ec26b990 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:08.200286 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5183695f-7b9c-4376-b322-c788ec26b990 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:08.200729 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5183695f-7b9c-4376-b322-c788ec26b990 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:08.361987 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-5183695f-7b9c-4376-b322-c788ec26b990 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:08.371410 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-5183695f-7b9c-4376-b322-c788ec26b990 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1701 microversion: 2.1 time: 0.183185 Dec 20 03:31:08.371995 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 168/350] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:08 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1701 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:08.388491 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b40d8f86-d5fe-45b9-baed-75f10df0c082 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:31:08.396739 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b40d8f86-d5fe-45b9-baed-75f10df0c082 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:08.397231 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b40d8f86-d5fe-45b9-baed-75f10df0c082 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:08.433718 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f6d09d26-6643-4ba9-8813-12471dfc0815 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:08.434386 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f6d09d26-6643-4ba9-8813-12471dfc0815 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:08.441553 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f6d09d26-6643-4ba9-8813-12471dfc0815 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:08.442041 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f6d09d26-6643-4ba9-8813-12471dfc0815 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:08.443081 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f6d09d26-6643-4ba9-8813-12471dfc0815 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:08.443727 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f6d09d26-6643-4ba9-8813-12471dfc0815 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:08.475768 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-b40d8f86-d5fe-45b9-baed-75f10df0c082 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Going to try to start instance {{(pid=117011) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 20 03:31:08.528190 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-f6d09d26-6643-4ba9-8813-12471dfc0815 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:08.536218 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f6d09d26-6643-4ba9-8813-12471dfc0815 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1270 microversion: 2.1 time: 0.106014 Dec 20 03:31:08.536801 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 169/351] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:08 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1270 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:08.758402 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b40d8f86-d5fe-45b9-baed-75f10df0c082 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 202 len: 0 microversion: 2.1 time: 0.372813 Dec 20 03:31:08.760015 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 183/352] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:31:08 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:31:08.768827 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7b55c2ff-c24a-4d78-98b0-4bb4eb8991ac tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:08.769476 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-7b55c2ff-c24a-4d78-98b0-4bb4eb8991ac tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:08.776962 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7b55c2ff-c24a-4d78-98b0-4bb4eb8991ac tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:08.777575 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7b55c2ff-c24a-4d78-98b0-4bb4eb8991ac tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:08.778468 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7b55c2ff-c24a-4d78-98b0-4bb4eb8991ac tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:08.779036 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7b55c2ff-c24a-4d78-98b0-4bb4eb8991ac tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:08.951831 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7b55c2ff-c24a-4d78-98b0-4bb4eb8991ac tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:08.960830 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7b55c2ff-c24a-4d78-98b0-4bb4eb8991ac tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1710 microversion: 2.1 time: 0.195584 Dec 20 03:31:08.961544 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 170/353] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:08 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1710 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:08.997619 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-9018f218-02f4-491a-bb85-98fdf05ecb7e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:08.998353 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-9018f218-02f4-491a-bb85-98fdf05ecb7e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:09.005564 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9018f218-02f4-491a-bb85-98fdf05ecb7e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:09.006157 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9018f218-02f4-491a-bb85-98fdf05ecb7e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:09.007004 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9018f218-02f4-491a-bb85-98fdf05ecb7e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:09.007539 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9018f218-02f4-491a-bb85-98fdf05ecb7e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:09.156981 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9018f218-02f4-491a-bb85-98fdf05ecb7e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:09.166989 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-9018f218-02f4-491a-bb85-98fdf05ecb7e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.174053 Dec 20 03:31:09.168559 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 184/354] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:08 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:09.553029 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-b8f2cc44-27d8-4e6f-b61e-4c67dffe482b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:09.553659 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-b8f2cc44-27d8-4e6f-b61e-4c67dffe482b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:09.560622 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b8f2cc44-27d8-4e6f-b61e-4c67dffe482b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:09.561073 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b8f2cc44-27d8-4e6f-b61e-4c67dffe482b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:09.561961 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b8f2cc44-27d8-4e6f-b61e-4c67dffe482b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:09.562391 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b8f2cc44-27d8-4e6f-b61e-4c67dffe482b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:09.635967 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-b8f2cc44-27d8-4e6f-b61e-4c67dffe482b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:09.643345 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-b8f2cc44-27d8-4e6f-b61e-4c67dffe482b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1270 microversion: 2.1 time: 0.094120 Dec 20 03:31:09.643906 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 171/355] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:09 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:09.978537 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a5465fdb-b534-45e1-9c95-ff93b5c50c28 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:09.979148 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a5465fdb-b534-45e1-9c95-ff93b5c50c28 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:09.985349 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a5465fdb-b534-45e1-9c95-ff93b5c50c28 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:09.985806 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a5465fdb-b534-45e1-9c95-ff93b5c50c28 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:09.986606 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a5465fdb-b534-45e1-9c95-ff93b5c50c28 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:09.987048 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a5465fdb-b534-45e1-9c95-ff93b5c50c28 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:10.142413 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-a5465fdb-b534-45e1-9c95-ff93b5c50c28 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:10.151878 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a5465fdb-b534-45e1-9c95-ff93b5c50c28 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1710 microversion: 2.1 time: 0.176814 Dec 20 03:31:10.152473 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 185/356] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:09 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1710 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:10.194705 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-0715db53-4bbd-4c29-8960-75e2aada5809 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:10.195359 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-0715db53-4bbd-4c29-8960-75e2aada5809 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:10.202025 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0715db53-4bbd-4c29-8960-75e2aada5809 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:10.202518 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0715db53-4bbd-4c29-8960-75e2aada5809 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:10.203324 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0715db53-4bbd-4c29-8960-75e2aada5809 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:10.203790 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0715db53-4bbd-4c29-8960-75e2aada5809 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:10.399499 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0715db53-4bbd-4c29-8960-75e2aada5809 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:10.407663 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-0715db53-4bbd-4c29-8960-75e2aada5809 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.217495 Dec 20 03:31:10.408249 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 172/357] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:10 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:10.661817 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-6f41f74b-c9c3-4bf4-bd00-d328a9c52087 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:10.662396 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6f41f74b-c9c3-4bf4-bd00-d328a9c52087 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:10.668976 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6f41f74b-c9c3-4bf4-bd00-d328a9c52087 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:10.669597 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6f41f74b-c9c3-4bf4-bd00-d328a9c52087 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:10.670442 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6f41f74b-c9c3-4bf4-bd00-d328a9c52087 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:10.670933 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6f41f74b-c9c3-4bf4-bd00-d328a9c52087 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:10.745880 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6f41f74b-c9c3-4bf4-bd00-d328a9c52087 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:10.755245 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-6f41f74b-c9c3-4bf4-bd00-d328a9c52087 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1270 microversion: 2.1 time: 0.097738 Dec 20 03:31:10.765645 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 186/358] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:10 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1270 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:11.169758 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-facb6904-4760-44d4-9f76-b25ad613754a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:11.170334 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-facb6904-4760-44d4-9f76-b25ad613754a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:11.178415 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-facb6904-4760-44d4-9f76-b25ad613754a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:11.178865 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-facb6904-4760-44d4-9f76-b25ad613754a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:11.179668 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-facb6904-4760-44d4-9f76-b25ad613754a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:11.180104 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-facb6904-4760-44d4-9f76-b25ad613754a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:11.346805 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-facb6904-4760-44d4-9f76-b25ad613754a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:11.370340 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-facb6904-4760-44d4-9f76-b25ad613754a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1710 microversion: 2.1 time: 0.204343 Dec 20 03:31:11.378095 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 173/359] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:11 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1710 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:11.428856 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e4ba857d-ab85-4c8f-9dc8-07de5e93c6ff tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:11.429888 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e4ba857d-ab85-4c8f-9dc8-07de5e93c6ff tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:11.442830 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e4ba857d-ab85-4c8f-9dc8-07de5e93c6ff tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:11.442830 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e4ba857d-ab85-4c8f-9dc8-07de5e93c6ff tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:11.442830 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e4ba857d-ab85-4c8f-9dc8-07de5e93c6ff tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:11.443674 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e4ba857d-ab85-4c8f-9dc8-07de5e93c6ff tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:11.745541 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-e4ba857d-ab85-4c8f-9dc8-07de5e93c6ff tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:11.755888 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e4ba857d-ab85-4c8f-9dc8-07de5e93c6ff tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.333733 Dec 20 03:31:11.756961 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 187/360] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:11 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:11.772460 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-0809a79d-4ea4-44f1-8596-86edc8468487 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:11.781985 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-0809a79d-4ea4-44f1-8596-86edc8468487 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:11.797064 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0809a79d-4ea4-44f1-8596-86edc8468487 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:11.797833 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0809a79d-4ea4-44f1-8596-86edc8468487 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:11.799913 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0809a79d-4ea4-44f1-8596-86edc8468487 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:11.804732 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0809a79d-4ea4-44f1-8596-86edc8468487 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:11.910829 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0809a79d-4ea4-44f1-8596-86edc8468487 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:11.918935 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-0809a79d-4ea4-44f1-8596-86edc8468487 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1276 microversion: 2.1 time: 0.150766 Dec 20 03:31:11.920101 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 174/361] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:11 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:12.390242 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-045dcbb9-f721-4ccb-a403-fb2a208b1589 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:12.390982 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-045dcbb9-f721-4ccb-a403-fb2a208b1589 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:12.399010 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-045dcbb9-f721-4ccb-a403-fb2a208b1589 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:12.400278 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-045dcbb9-f721-4ccb-a403-fb2a208b1589 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:12.403899 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-045dcbb9-f721-4ccb-a403-fb2a208b1589 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:12.404452 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-045dcbb9-f721-4ccb-a403-fb2a208b1589 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:12.604612 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-045dcbb9-f721-4ccb-a403-fb2a208b1589 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:12.627080 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-045dcbb9-f721-4ccb-a403-fb2a208b1589 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1710 microversion: 2.1 time: 0.240514 Dec 20 03:31:12.627689 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 188/362] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:12 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1710 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:12.779469 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-9fb8053d-68bb-4e11-b004-e5050ea7cca8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:12.780749 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-9fb8053d-68bb-4e11-b004-e5050ea7cca8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:12.789872 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9fb8053d-68bb-4e11-b004-e5050ea7cca8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:12.790541 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9fb8053d-68bb-4e11-b004-e5050ea7cca8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:12.807818 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9fb8053d-68bb-4e11-b004-e5050ea7cca8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:12.807818 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9fb8053d-68bb-4e11-b004-e5050ea7cca8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:12.944570 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-8a282de6-0070-4df2-8200-1d4d31a095b8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:12.945278 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-8a282de6-0070-4df2-8200-1d4d31a095b8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:12.953103 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8a282de6-0070-4df2-8200-1d4d31a095b8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:12.953593 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8a282de6-0070-4df2-8200-1d4d31a095b8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:12.955226 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8a282de6-0070-4df2-8200-1d4d31a095b8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:12.955681 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8a282de6-0070-4df2-8200-1d4d31a095b8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:13.040572 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-9fb8053d-68bb-4e11-b004-e5050ea7cca8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:13.048498 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-9fb8053d-68bb-4e11-b004-e5050ea7cca8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.276359 Dec 20 03:31:13.049082 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 175/363] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:12 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:13.136825 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-8a282de6-0070-4df2-8200-1d4d31a095b8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:13.144660 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-8a282de6-0070-4df2-8200-1d4d31a095b8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1318 microversion: 2.1 time: 0.211086 Dec 20 03:31:13.145912 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 189/364] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:12 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:13.498960 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-60b11ca3-e61c-4f56-89d4-6ec061675c61 req-d2a6d137-7ae8-402b-9131-321d9b44254e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34f5947-d72d-47ad-992f-d7b79c785841", "tag": "3f062f8b-2da8-492a-bcae-5109d8bafbc8"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:31:13.501029 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:31:13.501029 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:31:13.511369 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-60b11ca3-e61c-4f56-89d4-6ec061675c61 req-d2a6d137-7ae8-402b-9131-321d9b44254e service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:13.513260 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-60b11ca3-e61c-4f56-89d4-6ec061675c61 req-d2a6d137-7ae8-402b-9131-321d9b44254e service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:13.536988 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-60b11ca3-e61c-4f56-89d4-6ec061675c61 req-d2a6d137-7ae8-402b-9131-321d9b44254e service nova] Creating event network-changed:3f062f8b-2da8-492a-bcae-5109d8bafbc8 for instance c34f5947-d72d-47ad-992f-d7b79c785841 on hv-cinder-81803 Dec 20 03:31:13.548364 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-60b11ca3-e61c-4f56-89d4-6ec061675c61 req-d2a6d137-7ae8-402b-9131-321d9b44254e service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052941 Dec 20 03:31:13.550551 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 176/365] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:31:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:31:13.644649 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-068ebb5b-5449-4bcd-ae53-8dfc8699e858 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:13.645683 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-068ebb5b-5449-4bcd-ae53-8dfc8699e858 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:13.655262 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-068ebb5b-5449-4bcd-ae53-8dfc8699e858 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:13.657063 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-068ebb5b-5449-4bcd-ae53-8dfc8699e858 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:13.657755 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-068ebb5b-5449-4bcd-ae53-8dfc8699e858 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:13.658484 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-068ebb5b-5449-4bcd-ae53-8dfc8699e858 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:13.949778 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-068ebb5b-5449-4bcd-ae53-8dfc8699e858 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:13.960544 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-068ebb5b-5449-4bcd-ae53-8dfc8699e858 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1714 microversion: 2.1 time: 0.319870 Dec 20 03:31:13.961258 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 190/366] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:13 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1714 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:14.067565 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1b941ec5-46c8-463e-88ea-7e45edf58c87 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:14.068207 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1b941ec5-46c8-463e-88ea-7e45edf58c87 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:14.074704 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1b941ec5-46c8-463e-88ea-7e45edf58c87 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:14.075163 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1b941ec5-46c8-463e-88ea-7e45edf58c87 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:14.075950 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1b941ec5-46c8-463e-88ea-7e45edf58c87 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:14.076395 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1b941ec5-46c8-463e-88ea-7e45edf58c87 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:14.163341 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e51c4be2-7bbf-4dab-b2fb-4dd22ba8803f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:14.163957 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e51c4be2-7bbf-4dab-b2fb-4dd22ba8803f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:14.171038 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e51c4be2-7bbf-4dab-b2fb-4dd22ba8803f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:14.171716 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e51c4be2-7bbf-4dab-b2fb-4dd22ba8803f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:14.172659 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e51c4be2-7bbf-4dab-b2fb-4dd22ba8803f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:14.173299 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e51c4be2-7bbf-4dab-b2fb-4dd22ba8803f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:14.234141 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1b941ec5-46c8-463e-88ea-7e45edf58c87 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:14.244139 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1b941ec5-46c8-463e-88ea-7e45edf58c87 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.181808 Dec 20 03:31:14.244825 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 177/367] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:14 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:14.456195 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-e51c4be2-7bbf-4dab-b2fb-4dd22ba8803f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:14.464950 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e51c4be2-7bbf-4dab-b2fb-4dd22ba8803f tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1318 microversion: 2.1 time: 0.306481 Dec 20 03:31:14.465568 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 191/368] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:14 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:15.275073 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e9e46855-30ba-4e33-93d3-f9b3628fc61b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:15.275791 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e9e46855-30ba-4e33-93d3-f9b3628fc61b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:15.282720 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e9e46855-30ba-4e33-93d3-f9b3628fc61b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:15.283171 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e9e46855-30ba-4e33-93d3-f9b3628fc61b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:15.283962 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e9e46855-30ba-4e33-93d3-f9b3628fc61b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:15.284401 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e9e46855-30ba-4e33-93d3-f9b3628fc61b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:15.435472 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-e9e46855-30ba-4e33-93d3-f9b3628fc61b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:15.443650 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e9e46855-30ba-4e33-93d3-f9b3628fc61b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.172666 Dec 20 03:31:15.444562 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 178/369] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:15 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:15.493045 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-bcb224d7-f496-4b13-a0b1-407cdb90a011 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:15.493830 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-bcb224d7-f496-4b13-a0b1-407cdb90a011 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:15.501110 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bcb224d7-f496-4b13-a0b1-407cdb90a011 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:15.501595 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bcb224d7-f496-4b13-a0b1-407cdb90a011 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:15.502381 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bcb224d7-f496-4b13-a0b1-407cdb90a011 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:15.502945 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bcb224d7-f496-4b13-a0b1-407cdb90a011 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:15.683382 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-bcb224d7-f496-4b13-a0b1-407cdb90a011 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:15.691425 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-bcb224d7-f496-4b13-a0b1-407cdb90a011 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1318 microversion: 2.1 time: 0.203984 Dec 20 03:31:15.692572 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 192/370] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:15 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:16.460312 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e2cd309e-70d6-4b3e-933d-e7c6b3851256 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:16.461025 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e2cd309e-70d6-4b3e-933d-e7c6b3851256 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:16.467439 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e2cd309e-70d6-4b3e-933d-e7c6b3851256 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:16.468174 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e2cd309e-70d6-4b3e-933d-e7c6b3851256 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:16.469054 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e2cd309e-70d6-4b3e-933d-e7c6b3851256 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:16.469524 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e2cd309e-70d6-4b3e-933d-e7c6b3851256 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:16.609342 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-e2cd309e-70d6-4b3e-933d-e7c6b3851256 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:16.620271 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e2cd309e-70d6-4b3e-933d-e7c6b3851256 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.164010 Dec 20 03:31:16.621170 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 179/371] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:16 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:16.708595 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-14e7d2b3-694c-48ab-b168-da0a54c217e0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:16.713622 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-14e7d2b3-694c-48ab-b168-da0a54c217e0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:16.715593 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-14e7d2b3-694c-48ab-b168-da0a54c217e0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:16.716032 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-14e7d2b3-694c-48ab-b168-da0a54c217e0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:16.716832 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-14e7d2b3-694c-48ab-b168-da0a54c217e0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:16.717304 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-14e7d2b3-694c-48ab-b168-da0a54c217e0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:16.861761 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-14e7d2b3-694c-48ab-b168-da0a54c217e0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:16.869367 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-14e7d2b3-694c-48ab-b168-da0a54c217e0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1318 microversion: 2.1 time: 0.164817 Dec 20 03:31:16.869844 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 193/372] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:16 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:17.638365 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-6978d989-58c5-452e-9067-a958095b5044 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:17.639113 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6978d989-58c5-452e-9067-a958095b5044 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:17.649276 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6978d989-58c5-452e-9067-a958095b5044 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:17.649905 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6978d989-58c5-452e-9067-a958095b5044 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:17.650709 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6978d989-58c5-452e-9067-a958095b5044 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:17.651146 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6978d989-58c5-452e-9067-a958095b5044 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:17.810098 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-6978d989-58c5-452e-9067-a958095b5044 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:17.818224 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-6978d989-58c5-452e-9067-a958095b5044 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.183418 Dec 20 03:31:17.818830 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 180/373] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:17 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:17.885997 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-bb240ec6-a168-4e25-8615-e4e2dd5ac9b4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:17.886809 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-bb240ec6-a168-4e25-8615-e4e2dd5ac9b4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:17.892714 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bb240ec6-a168-4e25-8615-e4e2dd5ac9b4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:17.893179 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bb240ec6-a168-4e25-8615-e4e2dd5ac9b4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:17.893982 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bb240ec6-a168-4e25-8615-e4e2dd5ac9b4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:17.894425 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bb240ec6-a168-4e25-8615-e4e2dd5ac9b4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:18.054603 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-bb240ec6-a168-4e25-8615-e4e2dd5ac9b4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:18.084672 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-bb240ec6-a168-4e25-8615-e4e2dd5ac9b4 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1318 microversion: 2.1 time: 0.184356 Dec 20 03:31:18.084672 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 194/374] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:17 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:18.835009 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a9476a72-df21-4d86-bfe4-1756f0c0d81f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:18.841640 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a9476a72-df21-4d86-bfe4-1756f0c0d81f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:18.843352 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a9476a72-df21-4d86-bfe4-1756f0c0d81f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:18.844029 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a9476a72-df21-4d86-bfe4-1756f0c0d81f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:18.844856 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a9476a72-df21-4d86-bfe4-1756f0c0d81f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:18.845348 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a9476a72-df21-4d86-bfe4-1756f0c0d81f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:19.004006 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-a9476a72-df21-4d86-bfe4-1756f0c0d81f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:19.011171 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a9476a72-df21-4d86-bfe4-1756f0c0d81f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.180511 Dec 20 03:31:19.011772 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 181/375] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:18 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:19.099930 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-fb8396e8-5a13-43ee-816b-c39e71ee86ca tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:19.100626 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-fb8396e8-5a13-43ee-816b-c39e71ee86ca tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:19.106753 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fb8396e8-5a13-43ee-816b-c39e71ee86ca tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:19.107202 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fb8396e8-5a13-43ee-816b-c39e71ee86ca tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:19.108225 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fb8396e8-5a13-43ee-816b-c39e71ee86ca tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:19.108417 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fb8396e8-5a13-43ee-816b-c39e71ee86ca tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:19.270184 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-fb8396e8-5a13-43ee-816b-c39e71ee86ca tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:19.278555 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-fb8396e8-5a13-43ee-816b-c39e71ee86ca tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1318 microversion: 2.1 time: 0.182915 Dec 20 03:31:19.279140 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 195/376] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:19 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:20.028662 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1df94135-eb51-47ac-b2ef-2bdcc485ef87 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:20.030095 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1df94135-eb51-47ac-b2ef-2bdcc485ef87 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:20.037590 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1df94135-eb51-47ac-b2ef-2bdcc485ef87 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:20.038620 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1df94135-eb51-47ac-b2ef-2bdcc485ef87 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:20.039512 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1df94135-eb51-47ac-b2ef-2bdcc485ef87 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:20.039965 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1df94135-eb51-47ac-b2ef-2bdcc485ef87 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:20.207784 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1df94135-eb51-47ac-b2ef-2bdcc485ef87 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:20.225026 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1df94135-eb51-47ac-b2ef-2bdcc485ef87 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.199610 Dec 20 03:31:20.225891 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 182/377] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:20 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:20.318933 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-342a7bf8-0bca-4e9a-8651-57d1eba3fab6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:20.318933 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-342a7bf8-0bca-4e9a-8651-57d1eba3fab6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:20.318933 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-342a7bf8-0bca-4e9a-8651-57d1eba3fab6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:20.318933 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-342a7bf8-0bca-4e9a-8651-57d1eba3fab6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:20.319778 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-342a7bf8-0bca-4e9a-8651-57d1eba3fab6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:20.319778 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-342a7bf8-0bca-4e9a-8651-57d1eba3fab6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:20.324261 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-132a3e2c-a7de-470d-a5d9-86ea24287b5c req-f4608ea2-67b7-4db4-ae9f-ac0126f6d38b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34f5947-d72d-47ad-992f-d7b79c785841", "name": "network-vif-plugged", "status": "completed", "tag": "3f062f8b-2da8-492a-bcae-5109d8bafbc8"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:31:20.327049 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:31:20.327049 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:31:20.337990 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-132a3e2c-a7de-470d-a5d9-86ea24287b5c req-f4608ea2-67b7-4db4-ae9f-ac0126f6d38b service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:20.345598 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-132a3e2c-a7de-470d-a5d9-86ea24287b5c req-f4608ea2-67b7-4db4-ae9f-ac0126f6d38b service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:20.352594 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-132a3e2c-a7de-470d-a5d9-86ea24287b5c req-f4608ea2-67b7-4db4-ae9f-ac0126f6d38b service nova] Creating event network-vif-plugged:3f062f8b-2da8-492a-bcae-5109d8bafbc8 for instance c34f5947-d72d-47ad-992f-d7b79c785841 on hv-cinder-81803 Dec 20 03:31:20.363069 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-132a3e2c-a7de-470d-a5d9-86ea24287b5c req-f4608ea2-67b7-4db4-ae9f-ac0126f6d38b service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048429 Dec 20 03:31:20.364000 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 183/378] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:31:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:31:20.503885 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-342a7bf8-0bca-4e9a-8651-57d1eba3fab6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:20.512606 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-342a7bf8-0bca-4e9a-8651-57d1eba3fab6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1318 microversion: 2.1 time: 0.220203 Dec 20 03:31:20.515084 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 196/379] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:20 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:21.247591 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-bfbefee9-ceb7-461c-965a-724591595c7d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:21.248450 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-bfbefee9-ceb7-461c-965a-724591595c7d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:21.256121 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bfbefee9-ceb7-461c-965a-724591595c7d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:21.257243 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bfbefee9-ceb7-461c-965a-724591595c7d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:21.265830 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bfbefee9-ceb7-461c-965a-724591595c7d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:21.266330 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bfbefee9-ceb7-461c-965a-724591595c7d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:21.448974 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-bfbefee9-ceb7-461c-965a-724591595c7d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:21.457816 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-bfbefee9-ceb7-461c-965a-724591595c7d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.214904 Dec 20 03:31:21.458820 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 184/380] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:21 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:21.533673 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0744e86e-da26-4a49-86cb-6ab2bfbb8534 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:21.534992 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-0744e86e-da26-4a49-86cb-6ab2bfbb8534 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:21.545682 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0744e86e-da26-4a49-86cb-6ab2bfbb8534 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:21.546701 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0744e86e-da26-4a49-86cb-6ab2bfbb8534 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:21.547878 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0744e86e-da26-4a49-86cb-6ab2bfbb8534 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:21.548751 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0744e86e-da26-4a49-86cb-6ab2bfbb8534 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:21.705727 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-0744e86e-da26-4a49-86cb-6ab2bfbb8534 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:21.720848 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-0744e86e-da26-4a49-86cb-6ab2bfbb8534 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1318 microversion: 2.1 time: 0.193173 Dec 20 03:31:21.722295 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 197/381] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:21 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:22.476375 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-12c50523-5eba-4249-ace8-03178f8e82d3 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:22.477869 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-12c50523-5eba-4249-ace8-03178f8e82d3 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:22.485492 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-12c50523-5eba-4249-ace8-03178f8e82d3 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:22.486025 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-12c50523-5eba-4249-ace8-03178f8e82d3 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:22.487490 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-12c50523-5eba-4249-ace8-03178f8e82d3 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:22.487887 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-12c50523-5eba-4249-ace8-03178f8e82d3 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:22.668299 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-12c50523-5eba-4249-ace8-03178f8e82d3 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:22.680234 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-12c50523-5eba-4249-ace8-03178f8e82d3 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.208148 Dec 20 03:31:22.685198 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 185/382] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:22 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:22.745208 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-bbbd25ba-d65b-4ad2-8778-a75e0fcce672 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:22.746511 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-bbbd25ba-d65b-4ad2-8778-a75e0fcce672 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:22.761418 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bbbd25ba-d65b-4ad2-8778-a75e0fcce672 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:22.761418 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bbbd25ba-d65b-4ad2-8778-a75e0fcce672 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:22.762179 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bbbd25ba-d65b-4ad2-8778-a75e0fcce672 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:22.763091 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bbbd25ba-d65b-4ad2-8778-a75e0fcce672 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:22.977310 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-bbbd25ba-d65b-4ad2-8778-a75e0fcce672 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:22.987381 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-bbbd25ba-d65b-4ad2-8778-a75e0fcce672 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1508 microversion: 2.1 time: 0.250502 Dec 20 03:31:22.988485 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 198/383] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:22 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1508 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:23.704745 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-54250262-8286-48ce-adf7-de6b8e470790 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:23.705805 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-54250262-8286-48ce-adf7-de6b8e470790 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:23.713385 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-54250262-8286-48ce-adf7-de6b8e470790 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:23.713847 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-54250262-8286-48ce-adf7-de6b8e470790 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:23.714646 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-54250262-8286-48ce-adf7-de6b8e470790 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:23.715087 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-54250262-8286-48ce-adf7-de6b8e470790 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:23.871392 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-54250262-8286-48ce-adf7-de6b8e470790 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:23.880424 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-54250262-8286-48ce-adf7-de6b8e470790 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.180203 Dec 20 03:31:23.889559 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 186/384] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:23 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:24.058062 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-4a261239-45cb-4428-b999-a054ae741e54 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1479489136", "imageRef": "9c4ec443-915b-4997-82d3-08cc97ba635b", "flavorRef": "452"}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:31:24.137522 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.network.neutron [None req-4a261239-45cb-4428-b999-a054ae741e54 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] validate_networks() for None {{(pid=117011) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:31:24.441374 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-4a261239-45cb-4428-b999-a054ae741e54 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Flavor limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:31:24.442201 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-4a261239-45cb-4428-b999-a054ae741e54 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Image limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:31:24.442792 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-4a261239-45cb-4428-b999-a054ae741e54 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Flavor pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:31:24.444314 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-4a261239-45cb-4428-b999-a054ae741e54 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Image pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:31:24.444781 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-4a261239-45cb-4428-b999-a054ae741e54 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:31:24.464231 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4a261239-45cb-4428-b999-a054ae741e54 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:24.464231 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4a261239-45cb-4428-b999-a054ae741e54 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:24.464231 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4a261239-45cb-4428-b999-a054ae741e54 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:24.464231 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4a261239-45cb-4428-b999-a054ae741e54 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:24.484778 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-4a261239-45cb-4428-b999-a054ae741e54 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Getting quotas for project 6866bc2e71464c7899f85564f604f7ef. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:31:24.492935 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-4a261239-45cb-4428-b999-a054ae741e54 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Getting quotas for user 0125545010294077a700465430c13b48 and project 6866bc2e71464c7899f85564f604f7ef. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:31:24.509672 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-4a261239-45cb-4428-b999-a054ae741e54 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Going to run 1 instances... {{(pid=117011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:31:24.512582 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-4a261239-45cb-4428-b999-a054ae741e54 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c4ec443-915b-4997-82d3-08cc97ba635b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:31:24.655135 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-4a261239-45cb-4428-b999-a054ae741e54 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601584 Dec 20 03:31:24.656633 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 199/385] 10.222.0.53 () {60 vars in 1146 bytes} [Mon Dec 20 03:31:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 03:31:24.672456 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a4897bd4-83f7-4684-9438-bfda864c980b tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:24.672456 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a4897bd4-83f7-4684-9438-bfda864c980b tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:24.725565 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-a4897bd4-83f7-4684-9438-bfda864c980b tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0125545010294077a700465430c13b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6866bc2e71464c7899f85564f604f7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:24.732707 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a4897bd4-83f7-4684-9438-bfda864c980b tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 200 len: 1215 microversion: 2.1 time: 0.069982 Dec 20 03:31:24.743952 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 187/386] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:24 2021] GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:24.814512 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-4183564d-d42b-4cf2-aeca-bc7ec37ac556 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e690b5b-e3be-4b06-a118-725c1255c313"}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:31:24.815727 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-4183564d-d42b-4cf2-aeca-bc7ec37ac556 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:24.823444 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4183564d-d42b-4cf2-aeca-bc7ec37ac556 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:24.829342 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4183564d-d42b-4cf2-aeca-bc7ec37ac556 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:24.829342 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4183564d-d42b-4cf2-aeca-bc7ec37ac556 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:24.829342 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4183564d-d42b-4cf2-aeca-bc7ec37ac556 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:24.909052 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c7cadad4-09e9-446f-8ef9-053068198a37 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:24.909052 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c7cadad4-09e9-446f-8ef9-053068198a37 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:24.915323 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c7cadad4-09e9-446f-8ef9-053068198a37 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:24.916024 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c7cadad4-09e9-446f-8ef9-053068198a37 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:24.917058 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c7cadad4-09e9-446f-8ef9-053068198a37 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:24.918840 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c7cadad4-09e9-446f-8ef9-053068198a37 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:25.124246 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c7cadad4-09e9-446f-8ef9-053068198a37 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:25.133195 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c7cadad4-09e9-446f-8ef9-053068198a37 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.233843 Dec 20 03:31:25.134329 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 188/387] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:24 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:25.751623 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-3553de4d-4f60-4aea-b412-964a684389a0 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:25.752300 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-3553de4d-4f60-4aea-b412-964a684389a0 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:25.805761 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-3553de4d-4f60-4aea-b412-964a684389a0 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0125545010294077a700465430c13b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6866bc2e71464c7899f85564f604f7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:25.812782 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-3553de4d-4f60-4aea-b412-964a684389a0 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 200 len: 1215 microversion: 2.1 time: 0.064824 Dec 20 03:31:25.813313 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 189/388] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:25 2021] GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:25.975670 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-4183564d-d42b-4cf2-aeca-bc7ec37ac556 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "POST /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.164702 Dec 20 03:31:25.977195 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 200/389] 10.222.0.53 () {60 vars in 1322 bytes} [Mon Dec 20 03:31:24 2021] POST /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841/os-volume_attachments => generated 194 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:31:26.155673 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-6b24e957-9343-4a0f-9f2f-2c80024220cb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:26.156324 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6b24e957-9343-4a0f-9f2f-2c80024220cb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:26.162727 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6b24e957-9343-4a0f-9f2f-2c80024220cb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:26.163197 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6b24e957-9343-4a0f-9f2f-2c80024220cb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:26.164038 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6b24e957-9343-4a0f-9f2f-2c80024220cb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:26.164482 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6b24e957-9343-4a0f-9f2f-2c80024220cb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:26.325568 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-6b24e957-9343-4a0f-9f2f-2c80024220cb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:26.334618 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-6b24e957-9343-4a0f-9f2f-2c80024220cb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.182347 Dec 20 03:31:26.335598 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 190/390] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:26 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:26.831735 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-67601c3c-eda2-4cd6-9822-7c6150fd1b48 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:26.832746 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-67601c3c-eda2-4cd6-9822-7c6150fd1b48 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:26.843218 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-67601c3c-eda2-4cd6-9822-7c6150fd1b48 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:26.843759 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-67601c3c-eda2-4cd6-9822-7c6150fd1b48 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:26.844709 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-67601c3c-eda2-4cd6-9822-7c6150fd1b48 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:26.845255 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-67601c3c-eda2-4cd6-9822-7c6150fd1b48 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:26.924109 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-67601c3c-eda2-4cd6-9822-7c6150fd1b48 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0125545010294077a700465430c13b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6866bc2e71464c7899f85564f604f7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:26.932577 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-67601c3c-eda2-4cd6-9822-7c6150fd1b48 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 200 len: 1211 microversion: 2.1 time: 0.105788 Dec 20 03:31:26.933408 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 201/391] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:26 2021] GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 1211 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:27.357627 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-0c8d3ace-bf6e-4612-b81a-a4436c43cf96 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:27.358655 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-0c8d3ace-bf6e-4612-b81a-a4436c43cf96 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:27.367768 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0c8d3ace-bf6e-4612-b81a-a4436c43cf96 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:27.368218 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0c8d3ace-bf6e-4612-b81a-a4436c43cf96 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:27.369018 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0c8d3ace-bf6e-4612-b81a-a4436c43cf96 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:27.369484 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0c8d3ace-bf6e-4612-b81a-a4436c43cf96 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:27.522189 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0c8d3ace-bf6e-4612-b81a-a4436c43cf96 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:27.537467 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-0c8d3ace-bf6e-4612-b81a-a4436c43cf96 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.185179 Dec 20 03:31:27.538923 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 191/392] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:27 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:27.949958 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0e630189-3389-481a-8b2f-e1e671961997 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:27.950514 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-0e630189-3389-481a-8b2f-e1e671961997 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:27.959473 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0e630189-3389-481a-8b2f-e1e671961997 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:27.960082 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0e630189-3389-481a-8b2f-e1e671961997 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:27.961832 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0e630189-3389-481a-8b2f-e1e671961997 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:27.962633 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0e630189-3389-481a-8b2f-e1e671961997 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:28.301555 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-0e630189-3389-481a-8b2f-e1e671961997 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0125545010294077a700465430c13b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6866bc2e71464c7899f85564f604f7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:28.309909 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-0e630189-3389-481a-8b2f-e1e671961997 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 200 len: 1275 microversion: 2.1 time: 0.363601 Dec 20 03:31:28.310554 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 202/393] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:27 2021] GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 1275 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:28.556396 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7a6eb902-f7a3-4b04-8247-0f09c3e87d60 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:28.563143 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-7a6eb902-f7a3-4b04-8247-0f09c3e87d60 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:28.571097 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7a6eb902-f7a3-4b04-8247-0f09c3e87d60 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:28.571550 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7a6eb902-f7a3-4b04-8247-0f09c3e87d60 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:28.572552 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7a6eb902-f7a3-4b04-8247-0f09c3e87d60 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:28.572996 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7a6eb902-f7a3-4b04-8247-0f09c3e87d60 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:28.732677 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7a6eb902-f7a3-4b04-8247-0f09c3e87d60 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:28.740548 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7a6eb902-f7a3-4b04-8247-0f09c3e87d60 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.188621 Dec 20 03:31:28.741148 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 192/394] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:28 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:29.327925 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-48040b98-cbcb-4524-aa35-56e0b0e56557 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:29.328634 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-48040b98-cbcb-4524-aa35-56e0b0e56557 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:29.335907 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-48040b98-cbcb-4524-aa35-56e0b0e56557 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:29.336319 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-48040b98-cbcb-4524-aa35-56e0b0e56557 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:29.337626 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-48040b98-cbcb-4524-aa35-56e0b0e56557 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:29.338191 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-48040b98-cbcb-4524-aa35-56e0b0e56557 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:29.546288 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-48040b98-cbcb-4524-aa35-56e0b0e56557 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0125545010294077a700465430c13b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6866bc2e71464c7899f85564f604f7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:29.559079 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-48040b98-cbcb-4524-aa35-56e0b0e56557 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 200 len: 1315 microversion: 2.1 time: 0.235427 Dec 20 03:31:29.569607 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 203/395] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:29 2021] GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:29.763955 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-37ab58e4-618b-42d8-af04-8fd0d76b582a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:29.766292 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-37ab58e4-618b-42d8-af04-8fd0d76b582a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:29.787559 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-37ab58e4-618b-42d8-af04-8fd0d76b582a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:29.793558 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-37ab58e4-618b-42d8-af04-8fd0d76b582a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:29.794866 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-37ab58e4-618b-42d8-af04-8fd0d76b582a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:29.795507 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-37ab58e4-618b-42d8-af04-8fd0d76b582a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:29.990211 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-37ab58e4-618b-42d8-af04-8fd0d76b582a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:30.001698 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-37ab58e4-618b-42d8-af04-8fd0d76b582a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.245595 Dec 20 03:31:30.005504 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 193/396] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:29 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:30.576486 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-094ae887-530e-43e5-99ad-f444211432cd tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:30.577679 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-094ae887-530e-43e5-99ad-f444211432cd tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:30.588970 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-094ae887-530e-43e5-99ad-f444211432cd tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:30.605666 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-094ae887-530e-43e5-99ad-f444211432cd tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:30.609400 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-094ae887-530e-43e5-99ad-f444211432cd tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:30.610009 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-094ae887-530e-43e5-99ad-f444211432cd tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:30.894034 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-094ae887-530e-43e5-99ad-f444211432cd tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0125545010294077a700465430c13b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6866bc2e71464c7899f85564f604f7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:30.906769 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-094ae887-530e-43e5-99ad-f444211432cd tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 200 len: 1315 microversion: 2.1 time: 0.333843 Dec 20 03:31:30.907897 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 204/397] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:30 2021] GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:31.047945 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-48170cf6-dd9f-4df6-9d69-b9af4c137353 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:31.047945 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-48170cf6-dd9f-4df6-9d69-b9af4c137353 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:31.047945 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-48170cf6-dd9f-4df6-9d69-b9af4c137353 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:31.047945 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-48170cf6-dd9f-4df6-9d69-b9af4c137353 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:31.048974 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-ce41eef8-f4e2-4723-9d8b-4697990996a4 req-7946bb20-46a0-4ab1-b95f-248ffc6f8b84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5578527e-afe7-41bb-95f2-be172e989cab", "tag": "67ca6f6d-dd2b-40ae-b96e-83723598480b"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:31:31.048974 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:31:31.048974 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:31:31.051238 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-48170cf6-dd9f-4df6-9d69-b9af4c137353 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:31.052227 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-48170cf6-dd9f-4df6-9d69-b9af4c137353 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:31.064056 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-ce41eef8-f4e2-4723-9d8b-4697990996a4 req-7946bb20-46a0-4ab1-b95f-248ffc6f8b84 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:31.068975 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-ce41eef8-f4e2-4723-9d8b-4697990996a4 req-7946bb20-46a0-4ab1-b95f-248ffc6f8b84 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:31.087228 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-ce41eef8-f4e2-4723-9d8b-4697990996a4 req-7946bb20-46a0-4ab1-b95f-248ffc6f8b84 service nova] Creating event network-changed:67ca6f6d-dd2b-40ae-b96e-83723598480b for instance 5578527e-afe7-41bb-95f2-be172e989cab on hv-cinder-81803 Dec 20 03:31:31.092581 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-ce41eef8-f4e2-4723-9d8b-4697990996a4 req-7946bb20-46a0-4ab1-b95f-248ffc6f8b84 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055071 Dec 20 03:31:31.093769 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 205/398] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:31:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:31:31.282634 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-48170cf6-dd9f-4df6-9d69-b9af4c137353 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:31.307644 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-48170cf6-dd9f-4df6-9d69-b9af4c137353 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.287148 Dec 20 03:31:31.310519 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 194/399] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:31 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:31.936348 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ef308d22-a51c-473c-b54a-554d47f69926 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:31.937464 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ef308d22-a51c-473c-b54a-554d47f69926 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:31.943608 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ef308d22-a51c-473c-b54a-554d47f69926 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:31.944008 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ef308d22-a51c-473c-b54a-554d47f69926 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:31.944831 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ef308d22-a51c-473c-b54a-554d47f69926 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:31.945461 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ef308d22-a51c-473c-b54a-554d47f69926 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:32.208961 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ef308d22-a51c-473c-b54a-554d47f69926 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0125545010294077a700465430c13b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6866bc2e71464c7899f85564f604f7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:32.217115 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ef308d22-a51c-473c-b54a-554d47f69926 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 200 len: 1315 microversion: 2.1 time: 0.285428 Dec 20 03:31:32.217703 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 206/400] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:31 2021] GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:32.329749 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a40bd09a-e1d9-4490-a1f9-95a5249bc3bb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:32.330389 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a40bd09a-e1d9-4490-a1f9-95a5249bc3bb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:32.338857 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a40bd09a-e1d9-4490-a1f9-95a5249bc3bb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:32.339462 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a40bd09a-e1d9-4490-a1f9-95a5249bc3bb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:32.340370 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a40bd09a-e1d9-4490-a1f9-95a5249bc3bb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:32.341658 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a40bd09a-e1d9-4490-a1f9-95a5249bc3bb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:32.532448 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-a40bd09a-e1d9-4490-a1f9-95a5249bc3bb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:32.540525 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a40bd09a-e1d9-4490-a1f9-95a5249bc3bb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.214959 Dec 20 03:31:32.541099 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 195/401] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:32 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:33.239077 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-753c9260-3b1c-400e-a9d3-89fdf795e4c7 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:33.239077 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-753c9260-3b1c-400e-a9d3-89fdf795e4c7 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:33.252080 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-753c9260-3b1c-400e-a9d3-89fdf795e4c7 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:33.252450 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-753c9260-3b1c-400e-a9d3-89fdf795e4c7 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:33.253280 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-753c9260-3b1c-400e-a9d3-89fdf795e4c7 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:33.253721 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-753c9260-3b1c-400e-a9d3-89fdf795e4c7 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:33.397185 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-753c9260-3b1c-400e-a9d3-89fdf795e4c7 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0125545010294077a700465430c13b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6866bc2e71464c7899f85564f604f7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:33.405761 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-753c9260-3b1c-400e-a9d3-89fdf795e4c7 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 200 len: 1315 microversion: 2.1 time: 0.175154 Dec 20 03:31:33.406962 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 207/402] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:33 2021] GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:33.557766 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f84dd1c9-f2e3-497e-90eb-04f1f3e21ef4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:33.558315 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f84dd1c9-f2e3-497e-90eb-04f1f3e21ef4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:33.564596 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f84dd1c9-f2e3-497e-90eb-04f1f3e21ef4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:33.565054 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f84dd1c9-f2e3-497e-90eb-04f1f3e21ef4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:33.565954 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f84dd1c9-f2e3-497e-90eb-04f1f3e21ef4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:33.566411 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f84dd1c9-f2e3-497e-90eb-04f1f3e21ef4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:33.708703 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-f84dd1c9-f2e3-497e-90eb-04f1f3e21ef4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:33.716104 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f84dd1c9-f2e3-497e-90eb-04f1f3e21ef4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.163004 Dec 20 03:31:33.716666 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 196/403] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:33 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:34.423565 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a0e7442e-18a6-43ec-8c73-78353e35cbd2 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:34.424162 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a0e7442e-18a6-43ec-8c73-78353e35cbd2 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:34.430563 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a0e7442e-18a6-43ec-8c73-78353e35cbd2 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:34.431010 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a0e7442e-18a6-43ec-8c73-78353e35cbd2 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:34.431826 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a0e7442e-18a6-43ec-8c73-78353e35cbd2 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:34.432268 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a0e7442e-18a6-43ec-8c73-78353e35cbd2 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:34.579911 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-a0e7442e-18a6-43ec-8c73-78353e35cbd2 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0125545010294077a700465430c13b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6866bc2e71464c7899f85564f604f7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:34.589061 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a0e7442e-18a6-43ec-8c73-78353e35cbd2 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 200 len: 1315 microversion: 2.1 time: 0.169128 Dec 20 03:31:34.589882 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 208/404] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:34 2021] GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:34.715758 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-b8690a1c-f5c2-4287-86f7-4bfd090dd2db tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:34.716525 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-b8690a1c-f5c2-4287-86f7-4bfd090dd2db tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:34.722618 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b8690a1c-f5c2-4287-86f7-4bfd090dd2db tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:34.723041 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b8690a1c-f5c2-4287-86f7-4bfd090dd2db tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:34.723818 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b8690a1c-f5c2-4287-86f7-4bfd090dd2db tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:34.724247 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b8690a1c-f5c2-4287-86f7-4bfd090dd2db tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:34.732706 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-3113fda8-da39-4abc-94c4-408100c76318 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:34.733605 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-3113fda8-da39-4abc-94c4-408100c76318 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:34.739973 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3113fda8-da39-4abc-94c4-408100c76318 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:34.740425 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3113fda8-da39-4abc-94c4-408100c76318 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:34.741314 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3113fda8-da39-4abc-94c4-408100c76318 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:34.741757 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3113fda8-da39-4abc-94c4-408100c76318 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:34.805312 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.objects.instance [None req-b8690a1c-f5c2-4287-86f7-4bfd090dd2db tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lazy-loading 'services' on Instance uuid c34f5947-d72d-47ad-992f-d7b79c785841 {{(pid=117012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:31:34.924073 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-3113fda8-da39-4abc-94c4-408100c76318 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:34.933224 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-3113fda8-da39-4abc-94c4-408100c76318 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.203999 Dec 20 03:31:34.933819 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 209/405] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:34 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:35.019854 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-b8690a1c-f5c2-4287-86f7-4bfd090dd2db tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "DELETE /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841/os-volume_attachments/7e690b5b-e3be-4b06-a118-725c1255c313" status: 202 len: 0 microversion: 2.1 time: 0.307566 Dec 20 03:31:35.020865 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 197/406] 10.222.0.53 () {58 vars in 1415 bytes} [Mon Dec 20 03:31:34 2021] DELETE /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841/os-volume_attachments/7e690b5b-e3be-4b06-a118-725c1255c313 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:31:35.031225 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-17d3fab7-e2aa-4e99-b19b-97586d8beed6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:35.032302 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-17d3fab7-e2aa-4e99-b19b-97586d8beed6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:35.038977 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-17d3fab7-e2aa-4e99-b19b-97586d8beed6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:35.039424 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-17d3fab7-e2aa-4e99-b19b-97586d8beed6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:35.040212 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-17d3fab7-e2aa-4e99-b19b-97586d8beed6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:35.040627 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-17d3fab7-e2aa-4e99-b19b-97586d8beed6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:35.071308 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-17d3fab7-e2aa-4e99-b19b-97586d8beed6 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044445 Dec 20 03:31:35.071762 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 210/407] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:31:35 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:31:35.166697 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e6d46542-e7ad-4ac9-bc88-31e14c76bbdd tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1591757998", "imageRef": "9c4ec443-915b-4997-82d3-08cc97ba635b", "flavorRef": "452", "networks": [{"uuid": "04fe64b7-d33c-4d47-90a3-8de2f67e8986"}]}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:31:35.220906 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.network.neutron [None req-e6d46542-e7ad-4ac9-bc88-31e14c76bbdd tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] validate_networks() for [('04fe64b7-d33c-4d47-90a3-8de2f67e8986', None, None, None, None, None)] {{(pid=117012) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:31:35.608052 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-cac4a771-5fc0-40cc-916b-b8c07ceccee1 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:35.608730 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-cac4a771-5fc0-40cc-916b-b8c07ceccee1 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:35.616304 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-cac4a771-5fc0-40cc-916b-b8c07ceccee1 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:35.617928 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-cac4a771-5fc0-40cc-916b-b8c07ceccee1 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:35.620049 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-cac4a771-5fc0-40cc-916b-b8c07ceccee1 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:35.620049 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-cac4a771-5fc0-40cc-916b-b8c07ceccee1 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:35.631201 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-e6d46542-e7ad-4ac9-bc88-31e14c76bbdd tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Flavor limits 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:31:35.631683 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-e6d46542-e7ad-4ac9-bc88-31e14c76bbdd tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Image limits 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:31:35.632257 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-e6d46542-e7ad-4ac9-bc88-31e14c76bbdd tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Flavor pref 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:31:35.632670 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-e6d46542-e7ad-4ac9-bc88-31e14c76bbdd tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Image pref 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:31:35.633418 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-e6d46542-e7ad-4ac9-bc88-31e14c76bbdd tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:31:35.643475 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e6d46542-e7ad-4ac9-bc88-31e14c76bbdd tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:35.643923 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e6d46542-e7ad-4ac9-bc88-31e14c76bbdd tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:35.644731 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e6d46542-e7ad-4ac9-bc88-31e14c76bbdd tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:35.645341 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e6d46542-e7ad-4ac9-bc88-31e14c76bbdd tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:35.674131 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-e6d46542-e7ad-4ac9-bc88-31e14c76bbdd tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Getting quotas for project 52b3f51f2d0f44ffab57b6f7798b66ce. Resources: {'instances', 'ram', 'cores'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:31:35.678997 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-e6d46542-e7ad-4ac9-bc88-31e14c76bbdd tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Getting quotas for user 4ccfa6b8be514860a43d28ea40638220 and project 52b3f51f2d0f44ffab57b6f7798b66ce. Resources: {'instances', 'ram', 'cores'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:31:35.695187 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e6d46542-e7ad-4ac9-bc88-31e14c76bbdd tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Going to run 1 instances... {{(pid=117012) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:31:35.697708 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e6d46542-e7ad-4ac9-bc88-31e14c76bbdd tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c4ec443-915b-4997-82d3-08cc97ba635b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117012) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:31:35.766878 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-cac4a771-5fc0-40cc-916b-b8c07ceccee1 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0125545010294077a700465430c13b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6866bc2e71464c7899f85564f604f7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:35.774770 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-cac4a771-5fc0-40cc-916b-b8c07ceccee1 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 200 len: 1315 microversion: 2.1 time: 0.171316 Dec 20 03:31:35.776179 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 211/408] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:35 2021] GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:35.805003 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e6d46542-e7ad-4ac9-bc88-31e14c76bbdd tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641884 Dec 20 03:31:35.806139 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 198/409] 10.222.0.53 () {60 vars in 1146 bytes} [Mon Dec 20 03:31:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 03:31:35.815477 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b87f82b0-f4c2-493d-ab54-3a9f603f695e tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:35.816083 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-b87f82b0-f4c2-493d-ab54-3a9f603f695e tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:35.866328 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b87f82b0-f4c2-493d-ab54-3a9f603f695e tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:35.873948 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b87f82b0-f4c2-493d-ab54-3a9f603f695e tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9" status: 200 len: 1219 microversion: 2.1 time: 0.062262 Dec 20 03:31:35.874525 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 212/410] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:35 2021] GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 => generated 1219 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:35.951448 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-54e43acf-9093-476e-803a-7e8c04019cea tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:35.952049 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-54e43acf-9093-476e-803a-7e8c04019cea tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:35.967918 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-54e43acf-9093-476e-803a-7e8c04019cea tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:35.968377 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-54e43acf-9093-476e-803a-7e8c04019cea tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:35.969222 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-54e43acf-9093-476e-803a-7e8c04019cea tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:35.969669 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-54e43acf-9093-476e-803a-7e8c04019cea tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:36.082142 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-15e2929f-aa6a-4c33-8d46-66b148eb6cd7 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:36.083101 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-15e2929f-aa6a-4c33-8d46-66b148eb6cd7 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:36.090598 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-15e2929f-aa6a-4c33-8d46-66b148eb6cd7 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:36.091035 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-15e2929f-aa6a-4c33-8d46-66b148eb6cd7 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:36.092105 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-15e2929f-aa6a-4c33-8d46-66b148eb6cd7 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:36.092493 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-15e2929f-aa6a-4c33-8d46-66b148eb6cd7 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:36.119130 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-54e43acf-9093-476e-803a-7e8c04019cea tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:36.128410 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-15e2929f-aa6a-4c33-8d46-66b148eb6cd7 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049692 Dec 20 03:31:36.128849 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-54e43acf-9093-476e-803a-7e8c04019cea tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.181266 Dec 20 03:31:36.129417 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 213/411] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:31:36 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:31:36.129964 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 199/412] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:35 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:36.792708 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-128ec2ba-67a6-46a5-aeeb-034352c6c6b5 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:36.793916 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-128ec2ba-67a6-46a5-aeeb-034352c6c6b5 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:36.805633 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-128ec2ba-67a6-46a5-aeeb-034352c6c6b5 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:36.806393 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-128ec2ba-67a6-46a5-aeeb-034352c6c6b5 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:36.807831 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-128ec2ba-67a6-46a5-aeeb-034352c6c6b5 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:36.808621 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-128ec2ba-67a6-46a5-aeeb-034352c6c6b5 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:36.892500 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-6983f117-79d5-481b-b8a7-030561d68677 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:36.893393 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6983f117-79d5-481b-b8a7-030561d68677 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:36.952501 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-6983f117-79d5-481b-b8a7-030561d68677 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:36.961168 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-6983f117-79d5-481b-b8a7-030561d68677 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9" status: 200 len: 1219 microversion: 2.1 time: 0.071669 Dec 20 03:31:36.962127 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 200/413] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:36 2021] GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:36.973672 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-128ec2ba-67a6-46a5-aeeb-034352c6c6b5 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0125545010294077a700465430c13b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6866bc2e71464c7899f85564f604f7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:36.985809 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-128ec2ba-67a6-46a5-aeeb-034352c6c6b5 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 200 len: 1315 microversion: 2.1 time: 0.195460 Dec 20 03:31:36.985809 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 214/414] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:36 2021] GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:37.139571 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-89ef2024-0a6d-4dfc-8d4a-94b83351b485 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:37.140577 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-89ef2024-0a6d-4dfc-8d4a-94b83351b485 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:37.152135 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-305a068f-5d9e-4018-9aa7-19dffed8403f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:37.152744 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-305a068f-5d9e-4018-9aa7-19dffed8403f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:37.155003 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-89ef2024-0a6d-4dfc-8d4a-94b83351b485 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:37.155458 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-89ef2024-0a6d-4dfc-8d4a-94b83351b485 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:37.156269 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-89ef2024-0a6d-4dfc-8d4a-94b83351b485 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:37.156713 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-89ef2024-0a6d-4dfc-8d4a-94b83351b485 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:37.159287 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-305a068f-5d9e-4018-9aa7-19dffed8403f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:37.159858 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-305a068f-5d9e-4018-9aa7-19dffed8403f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:37.160657 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-305a068f-5d9e-4018-9aa7-19dffed8403f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:37.161115 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-305a068f-5d9e-4018-9aa7-19dffed8403f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:37.190554 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-89ef2024-0a6d-4dfc-8d4a-94b83351b485 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054834 Dec 20 03:31:37.191626 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 201/415] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:31:37 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 03:31:37.320323 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-305a068f-5d9e-4018-9aa7-19dffed8403f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:37.328718 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-305a068f-5d9e-4018-9aa7-19dffed8403f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.180208 Dec 20 03:31:37.329552 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 215/416] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:37 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:37.978422 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-2d0d530c-d488-4c8b-8b46-6d3d930f6284 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:37.979046 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-2d0d530c-d488-4c8b-8b46-6d3d930f6284 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:37.985838 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2d0d530c-d488-4c8b-8b46-6d3d930f6284 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:37.986291 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2d0d530c-d488-4c8b-8b46-6d3d930f6284 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:37.987103 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2d0d530c-d488-4c8b-8b46-6d3d930f6284 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:37.987550 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2d0d530c-d488-4c8b-8b46-6d3d930f6284 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:38.002429 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d31ea527-cf37-46ae-8ba1-6ce91a567ede tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:38.003191 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d31ea527-cf37-46ae-8ba1-6ce91a567ede tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:38.010849 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d31ea527-cf37-46ae-8ba1-6ce91a567ede tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:38.011527 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d31ea527-cf37-46ae-8ba1-6ce91a567ede tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:38.012337 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d31ea527-cf37-46ae-8ba1-6ce91a567ede tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:38.012776 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d31ea527-cf37-46ae-8ba1-6ce91a567ede tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:38.060493 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-2d0d530c-d488-4c8b-8b46-6d3d930f6284 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:38.068576 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-2d0d530c-d488-4c8b-8b46-6d3d930f6284 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9" status: 200 len: 1271 microversion: 2.1 time: 0.093872 Dec 20 03:31:38.069658 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 202/417] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:37 2021] GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:38.176796 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d31ea527-cf37-46ae-8ba1-6ce91a567ede tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0125545010294077a700465430c13b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6866bc2e71464c7899f85564f604f7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:38.184865 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d31ea527-cf37-46ae-8ba1-6ce91a567ede tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 200 len: 1315 microversion: 2.1 time: 0.186672 Dec 20 03:31:38.185481 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 216/418] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:37 2021] GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:38.345868 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-62a54959-d863-41dc-b549-7215210b1a6d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:38.346626 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-62a54959-d863-41dc-b549-7215210b1a6d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:38.356546 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-62a54959-d863-41dc-b549-7215210b1a6d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:38.356546 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-62a54959-d863-41dc-b549-7215210b1a6d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:38.356546 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-62a54959-d863-41dc-b549-7215210b1a6d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:38.356546 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-62a54959-d863-41dc-b549-7215210b1a6d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:38.373864 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-c96612ac-1783-49d2-b437-3360ba41c11f req-958d7a55-6b6b-433c-ae9c-15f07dd90cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5578527e-afe7-41bb-95f2-be172e989cab", "name": "network-vif-plugged", "status": "completed", "tag": "67ca6f6d-dd2b-40ae-b96e-83723598480b"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:31:38.376790 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:31:38.376790 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:31:38.392651 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-c96612ac-1783-49d2-b437-3360ba41c11f req-958d7a55-6b6b-433c-ae9c-15f07dd90cfd service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:38.393312 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-c96612ac-1783-49d2-b437-3360ba41c11f req-958d7a55-6b6b-433c-ae9c-15f07dd90cfd service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:38.409633 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-c96612ac-1783-49d2-b437-3360ba41c11f req-958d7a55-6b6b-433c-ae9c-15f07dd90cfd service nova] Creating event network-vif-plugged:67ca6f6d-dd2b-40ae-b96e-83723598480b for instance 5578527e-afe7-41bb-95f2-be172e989cab on hv-cinder-81803 Dec 20 03:31:38.416590 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-c96612ac-1783-49d2-b437-3360ba41c11f req-958d7a55-6b6b-433c-ae9c-15f07dd90cfd service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048743 Dec 20 03:31:38.421665 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 217/419] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:31:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:31:38.527868 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-62a54959-d863-41dc-b549-7215210b1a6d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:38.536671 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-62a54959-d863-41dc-b549-7215210b1a6d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.194425 Dec 20 03:31:38.537809 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 203/420] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:38 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:38.600145 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-c1f44b92-86ae-43a7-8779-875f27171e39 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:38.601597 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-c1f44b92-86ae-43a7-8779-875f27171e39 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:38.608722 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c1f44b92-86ae-43a7-8779-875f27171e39 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:38.609244 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c1f44b92-86ae-43a7-8779-875f27171e39 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:38.609929 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c1f44b92-86ae-43a7-8779-875f27171e39 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:38.610355 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c1f44b92-86ae-43a7-8779-875f27171e39 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:38.640552 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-c1f44b92-86ae-43a7-8779-875f27171e39 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Going to try to terminate instance {{(pid=117011) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:31:38.985703 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-c1f44b92-86ae-43a7-8779-875f27171e39 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "DELETE /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 204 len: 0 microversion: 2.1 time: 0.389638 Dec 20 03:31:38.986491 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 218/421] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:31:38 2021] DELETE /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:31:38.999652 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-fd32b08d-b559-4c74-a50c-6bc2c81ef009 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:39.001421 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-fd32b08d-b559-4c74-a50c-6bc2c81ef009 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:39.030687 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fd32b08d-b559-4c74-a50c-6bc2c81ef009 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:39.031426 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fd32b08d-b559-4c74-a50c-6bc2c81ef009 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:39.032483 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fd32b08d-b559-4c74-a50c-6bc2c81ef009 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:39.033087 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fd32b08d-b559-4c74-a50c-6bc2c81ef009 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:39.092928 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-908a8273-0334-40fe-a248-2ca4b818ecd9 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:39.095966 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-908a8273-0334-40fe-a248-2ca4b818ecd9 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:39.114687 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-908a8273-0334-40fe-a248-2ca4b818ecd9 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:39.115562 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-908a8273-0334-40fe-a248-2ca4b818ecd9 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:39.117330 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-908a8273-0334-40fe-a248-2ca4b818ecd9 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:39.118179 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-908a8273-0334-40fe-a248-2ca4b818ecd9 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:39.223770 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-908a8273-0334-40fe-a248-2ca4b818ecd9 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:39.236039 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-908a8273-0334-40fe-a248-2ca4b818ecd9 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9" status: 200 len: 1277 microversion: 2.1 time: 0.152326 Dec 20 03:31:39.236874 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 219/422] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:39 2021] GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:39.248900 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-018a1fe4-2617-43d6-96c2-addda8c0034e tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:39.250357 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-018a1fe4-2617-43d6-96c2-addda8c0034e tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:39.256755 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-018a1fe4-2617-43d6-96c2-addda8c0034e tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:39.257752 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-018a1fe4-2617-43d6-96c2-addda8c0034e tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:39.259453 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-018a1fe4-2617-43d6-96c2-addda8c0034e tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:39.259453 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-018a1fe4-2617-43d6-96c2-addda8c0034e tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:39.274963 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-fd32b08d-b559-4c74-a50c-6bc2c81ef009 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:39.284094 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-fd32b08d-b559-4c74-a50c-6bc2c81ef009 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1514 microversion: 2.1 time: 0.293311 Dec 20 03:31:39.285189 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 204/423] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:38 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1514 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:39.480767 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-018a1fe4-2617-43d6-96c2-addda8c0034e tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0125545010294077a700465430c13b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6866bc2e71464c7899f85564f604f7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:39.488735 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-018a1fe4-2617-43d6-96c2-addda8c0034e tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 200 len: 1315 microversion: 2.1 time: 0.250245 Dec 20 03:31:39.498642 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 220/424] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:39 2021] GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:39.555933 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-6df186a1-00ee-4897-a8f9-6783637ff30d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:39.556577 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6df186a1-00ee-4897-a8f9-6783637ff30d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:39.562804 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6df186a1-00ee-4897-a8f9-6783637ff30d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:39.563254 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6df186a1-00ee-4897-a8f9-6783637ff30d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:39.564088 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6df186a1-00ee-4897-a8f9-6783637ff30d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:39.564526 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6df186a1-00ee-4897-a8f9-6783637ff30d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:39.731555 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-6df186a1-00ee-4897-a8f9-6783637ff30d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:39.739193 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-6df186a1-00ee-4897-a8f9-6783637ff30d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.187585 Dec 20 03:31:39.739756 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 205/425] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:39 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:40.258018 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e4b76729-2950-4972-b98c-021af2cd1397 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:40.258790 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e4b76729-2950-4972-b98c-021af2cd1397 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:40.267787 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e4b76729-2950-4972-b98c-021af2cd1397 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:40.268302 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e4b76729-2950-4972-b98c-021af2cd1397 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:40.269650 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e4b76729-2950-4972-b98c-021af2cd1397 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:40.270251 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e4b76729-2950-4972-b98c-021af2cd1397 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:40.304087 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-fa2e67e3-e9f2-4686-84db-e6e1d33d532c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:40.305363 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-fa2e67e3-e9f2-4686-84db-e6e1d33d532c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:40.312272 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fa2e67e3-e9f2-4686-84db-e6e1d33d532c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:40.312837 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fa2e67e3-e9f2-4686-84db-e6e1d33d532c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:40.313757 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fa2e67e3-e9f2-4686-84db-e6e1d33d532c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:40.314278 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fa2e67e3-e9f2-4686-84db-e6e1d33d532c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:40.474281 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-fa2e67e3-e9f2-4686-84db-e6e1d33d532c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:40.483823 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-fa2e67e3-e9f2-4686-84db-e6e1d33d532c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1514 microversion: 2.1 time: 0.183316 Dec 20 03:31:40.484658 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 206/426] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:40 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:40.515625 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-3b6203c2-a3ee-4067-8d54-41513790765c tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:40.516507 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-3b6203c2-a3ee-4067-8d54-41513790765c tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:40.525044 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3b6203c2-a3ee-4067-8d54-41513790765c tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:40.526041 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3b6203c2-a3ee-4067-8d54-41513790765c tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:40.531092 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3b6203c2-a3ee-4067-8d54-41513790765c tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:40.531092 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3b6203c2-a3ee-4067-8d54-41513790765c tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:40.599644 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-e4b76729-2950-4972-b98c-021af2cd1397 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:40.618378 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e4b76729-2950-4972-b98c-021af2cd1397 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9" status: 200 len: 1319 microversion: 2.1 time: 0.364129 Dec 20 03:31:40.619108 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 221/427] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:40 2021] GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:40.690620 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-3b6203c2-a3ee-4067-8d54-41513790765c tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0125545010294077a700465430c13b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6866bc2e71464c7899f85564f604f7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:40.698488 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-3b6203c2-a3ee-4067-8d54-41513790765c tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 200 len: 1315 microversion: 2.1 time: 0.186857 Dec 20 03:31:40.699275 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 207/428] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:40 2021] GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:40.758592 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-6dc1fc66-4472-4828-b0e3-f8470cceb889 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:40.759255 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6dc1fc66-4472-4828-b0e3-f8470cceb889 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:40.765567 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6dc1fc66-4472-4828-b0e3-f8470cceb889 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:40.766093 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6dc1fc66-4472-4828-b0e3-f8470cceb889 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:40.766840 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6dc1fc66-4472-4828-b0e3-f8470cceb889 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:40.767287 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6dc1fc66-4472-4828-b0e3-f8470cceb889 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:40.981572 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6dc1fc66-4472-4828-b0e3-f8470cceb889 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:40.992127 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-6dc1fc66-4472-4828-b0e3-f8470cceb889 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1521 microversion: 2.1 time: 0.236679 Dec 20 03:31:40.993018 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 222/429] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:40 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:41.017446 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-83067c6f-ea32-49d2-b488-9dcf7f05ec7e req-a0c51879-466d-4e09-8e0b-b6942ad0ec59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbefc305-fd32-4fa9-9c3a-1c4e53b716b9", "tag": "e4415830-c355-4d6e-a000-020a900363fb"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:31:41.019803 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:31:41.019803 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:31:41.036598 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-83067c6f-ea32-49d2-b488-9dcf7f05ec7e req-a0c51879-466d-4e09-8e0b-b6942ad0ec59 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:41.037672 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-83067c6f-ea32-49d2-b488-9dcf7f05ec7e req-a0c51879-466d-4e09-8e0b-b6942ad0ec59 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:41.051305 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-83067c6f-ea32-49d2-b488-9dcf7f05ec7e req-a0c51879-466d-4e09-8e0b-b6942ad0ec59 service nova] Creating event network-changed:e4415830-c355-4d6e-a000-020a900363fb for instance bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 on hv-cinder-81803 Dec 20 03:31:41.057770 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-83067c6f-ea32-49d2-b488-9dcf7f05ec7e req-a0c51879-466d-4e09-8e0b-b6942ad0ec59 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044983 Dec 20 03:31:41.058379 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 208/430] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:31:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:31:41.506034 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-8edf5a4a-8066-444d-9aad-3d8b163bf60d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:41.507223 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-8edf5a4a-8066-444d-9aad-3d8b163bf60d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:41.517289 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8edf5a4a-8066-444d-9aad-3d8b163bf60d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:41.518031 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8edf5a4a-8066-444d-9aad-3d8b163bf60d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:41.519013 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8edf5a4a-8066-444d-9aad-3d8b163bf60d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:41.519441 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8edf5a4a-8066-444d-9aad-3d8b163bf60d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:41.642488 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-def8de46-3807-45c0-97e3-247f1de383ed tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:41.643290 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-def8de46-3807-45c0-97e3-247f1de383ed tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:41.652212 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-def8de46-3807-45c0-97e3-247f1de383ed tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:41.652769 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-def8de46-3807-45c0-97e3-247f1de383ed tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:41.653694 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-def8de46-3807-45c0-97e3-247f1de383ed tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:41.654293 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-def8de46-3807-45c0-97e3-247f1de383ed tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:41.777627 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-8edf5a4a-8066-444d-9aad-3d8b163bf60d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:41.798888 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-8edf5a4a-8066-444d-9aad-3d8b163bf60d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1514 microversion: 2.1 time: 0.291919 Dec 20 03:31:41.812104 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 223/431] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:41 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1514 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:41.829452 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-9dd051a7-184f-46d0-9b7c-b7f81262452a tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:41.829452 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-9dd051a7-184f-46d0-9b7c-b7f81262452a tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:41.834573 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9dd051a7-184f-46d0-9b7c-b7f81262452a tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:41.835972 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9dd051a7-184f-46d0-9b7c-b7f81262452a tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:41.837646 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9dd051a7-184f-46d0-9b7c-b7f81262452a tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:41.838404 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9dd051a7-184f-46d0-9b7c-b7f81262452a tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:41.848193 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-def8de46-3807-45c0-97e3-247f1de383ed tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:41.862977 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-def8de46-3807-45c0-97e3-247f1de383ed tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9" status: 200 len: 1319 microversion: 2.1 time: 0.225275 Dec 20 03:31:41.864109 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 209/432] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:41 2021] GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:42.016484 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-24b13a7a-979f-40da-a27c-d9989e61db9d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:42.017773 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-24b13a7a-979f-40da-a27c-d9989e61db9d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:42.027716 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-24b13a7a-979f-40da-a27c-d9989e61db9d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:42.028686 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-24b13a7a-979f-40da-a27c-d9989e61db9d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:42.030038 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-24b13a7a-979f-40da-a27c-d9989e61db9d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:42.030744 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-24b13a7a-979f-40da-a27c-d9989e61db9d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:42.037873 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9dd051a7-184f-46d0-9b7c-b7f81262452a tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0125545010294077a700465430c13b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6866bc2e71464c7899f85564f604f7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:42.047460 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-9dd051a7-184f-46d0-9b7c-b7f81262452a tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 200 len: 1465 microversion: 2.1 time: 0.233290 Dec 20 03:31:42.048041 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 224/433] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:41 2021] GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 1465 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:42.097882 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-aea01148-1f3b-4144-b7aa-89e4ff3c14ea tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:42.099078 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-aea01148-1f3b-4144-b7aa-89e4ff3c14ea tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:42.106140 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-aea01148-1f3b-4144-b7aa-89e4ff3c14ea tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:42.106701 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-aea01148-1f3b-4144-b7aa-89e4ff3c14ea tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:42.107578 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-aea01148-1f3b-4144-b7aa-89e4ff3c14ea tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:42.108079 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-aea01148-1f3b-4144-b7aa-89e4ff3c14ea tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:42.151328 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-aea01148-1f3b-4144-b7aa-89e4ff3c14ea tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Going to try to terminate instance {{(pid=117011) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:31:42.229592 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-24b13a7a-979f-40da-a27c-d9989e61db9d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:42.238051 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-24b13a7a-979f-40da-a27c-d9989e61db9d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1501 microversion: 2.1 time: 0.226905 Dec 20 03:31:42.238658 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 210/434] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:42 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1501 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:42.255441 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-0129f9a4-8862-48e1-8b2d-e98160767976 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:42.256059 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-0129f9a4-8862-48e1-8b2d-e98160767976 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:42.263576 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0129f9a4-8862-48e1-8b2d-e98160767976 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:42.263962 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0129f9a4-8862-48e1-8b2d-e98160767976 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:42.264779 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0129f9a4-8862-48e1-8b2d-e98160767976 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:42.265248 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0129f9a4-8862-48e1-8b2d-e98160767976 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:42.434268 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0129f9a4-8862-48e1-8b2d-e98160767976 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:42.444007 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-0129f9a4-8862-48e1-8b2d-e98160767976 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1516 microversion: 2.1 time: 0.192240 Dec 20 03:31:42.445438 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 211/435] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:42 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1516 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:42.546294 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-aea01148-1f3b-4144-b7aa-89e4ff3c14ea tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "DELETE /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 204 len: 0 microversion: 2.1 time: 0.451820 Dec 20 03:31:42.547311 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 225/436] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:31:42 2021] DELETE /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:31:42.556808 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-243f18bf-2ad8-40bd-966d-5f39a99c8333 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:42.557563 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-243f18bf-2ad8-40bd-966d-5f39a99c8333 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:42.563524 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-243f18bf-2ad8-40bd-966d-5f39a99c8333 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:42.564061 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-243f18bf-2ad8-40bd-966d-5f39a99c8333 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:42.564917 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-243f18bf-2ad8-40bd-966d-5f39a99c8333 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:42.565454 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-243f18bf-2ad8-40bd-966d-5f39a99c8333 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:42.827427 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-cbe3cf15-28c3-4f18-a230-6f653f09ba4a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:42.828400 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-cbe3cf15-28c3-4f18-a230-6f653f09ba4a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:42.838431 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-cbe3cf15-28c3-4f18-a230-6f653f09ba4a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:42.839151 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-cbe3cf15-28c3-4f18-a230-6f653f09ba4a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:42.840434 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-cbe3cf15-28c3-4f18-a230-6f653f09ba4a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:42.841566 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-cbe3cf15-28c3-4f18-a230-6f653f09ba4a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:42.906143 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-243f18bf-2ad8-40bd-966d-5f39a99c8333 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0125545010294077a700465430c13b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6866bc2e71464c7899f85564f604f7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:42.919981 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-243f18bf-2ad8-40bd-966d-5f39a99c8333 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 200 len: 1471 microversion: 2.1 time: 0.366560 Dec 20 03:31:42.921100 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 212/437] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:42 2021] GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 1471 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:42.930470 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-6f1ad75a-2595-4564-b25a-7093d36a5948 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:42.931679 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6f1ad75a-2595-4564-b25a-7093d36a5948 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:42.941733 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6f1ad75a-2595-4564-b25a-7093d36a5948 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:42.942709 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6f1ad75a-2595-4564-b25a-7093d36a5948 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:42.943994 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6f1ad75a-2595-4564-b25a-7093d36a5948 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:42.945688 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6f1ad75a-2595-4564-b25a-7093d36a5948 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:43.047381 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-cbe3cf15-28c3-4f18-a230-6f653f09ba4a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:43.051756 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-cbe3cf15-28c3-4f18-a230-6f653f09ba4a tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1514 microversion: 2.1 time: 0.228729 Dec 20 03:31:43.052446 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 226/438] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:42 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1514 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:43.128841 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-6f1ad75a-2595-4564-b25a-7093d36a5948 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:43.140345 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-6f1ad75a-2595-4564-b25a-7093d36a5948 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9" status: 200 len: 1319 microversion: 2.1 time: 0.217457 Dec 20 03:31:43.141090 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 213/439] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:42 2021] GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:43.863519 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-45cf8b0e-da1c-4625-a779-91d1f3f977e8 req-a3c92aea-a507-4b77-a6ef-ed53b03fd8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34f5947-d72d-47ad-992f-d7b79c785841", "name": "network-vif-deleted", "tag": "3f062f8b-2da8-492a-bcae-5109d8bafbc8"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:31:43.875273 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:31:43.875273 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:31:43.888453 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-45cf8b0e-da1c-4625-a779-91d1f3f977e8 req-a3c92aea-a507-4b77-a6ef-ed53b03fd8e9 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:43.892486 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-45cf8b0e-da1c-4625-a779-91d1f3f977e8 req-a3c92aea-a507-4b77-a6ef-ed53b03fd8e9 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:43.910521 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-45cf8b0e-da1c-4625-a779-91d1f3f977e8 req-a3c92aea-a507-4b77-a6ef-ed53b03fd8e9 service nova] Creating event network-vif-deleted:3f062f8b-2da8-492a-bcae-5109d8bafbc8 for instance c34f5947-d72d-47ad-992f-d7b79c785841 on hv-cinder-81803 Dec 20 03:31:43.917924 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-45cf8b0e-da1c-4625-a779-91d1f3f977e8 req-a3c92aea-a507-4b77-a6ef-ed53b03fd8e9 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061209 Dec 20 03:31:43.918568 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 227/440] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:31:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:31:43.937437 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-0cf229f8-d7e1-4752-83fc-caad433a6d72 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:43.938126 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-0cf229f8-d7e1-4752-83fc-caad433a6d72 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:43.946520 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0cf229f8-d7e1-4752-83fc-caad433a6d72 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:43.947083 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0cf229f8-d7e1-4752-83fc-caad433a6d72 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:43.948053 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0cf229f8-d7e1-4752-83fc-caad433a6d72 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:43.948526 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0cf229f8-d7e1-4752-83fc-caad433a6d72 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:44.073593 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-8a6f5683-e350-4c4f-b424-a2c9247c8610 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:44.075451 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-8a6f5683-e350-4c4f-b424-a2c9247c8610 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:44.087365 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8a6f5683-e350-4c4f-b424-a2c9247c8610 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:44.087812 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8a6f5683-e350-4c4f-b424-a2c9247c8610 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:44.089085 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8a6f5683-e350-4c4f-b424-a2c9247c8610 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:44.089085 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8a6f5683-e350-4c4f-b424-a2c9247c8610 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:44.155860 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0cf229f8-d7e1-4752-83fc-caad433a6d72 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0125545010294077a700465430c13b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6866bc2e71464c7899f85564f604f7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:44.173276 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-0cf229f8-d7e1-4752-83fc-caad433a6d72 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 200 len: 1471 microversion: 2.1 time: 0.239423 Dec 20 03:31:44.175145 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 214/441] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:43 2021] GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 1471 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:44.186307 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-12d093c6-6b1a-4563-a2cc-9e1a21328e13 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:44.187243 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-12d093c6-6b1a-4563-a2cc-9e1a21328e13 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:44.199407 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-8a6f5683-e350-4c4f-b424-a2c9247c8610 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:44.201392 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-12d093c6-6b1a-4563-a2cc-9e1a21328e13 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:44.202625 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-12d093c6-6b1a-4563-a2cc-9e1a21328e13 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:44.204905 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-12d093c6-6b1a-4563-a2cc-9e1a21328e13 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:44.211903 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-12d093c6-6b1a-4563-a2cc-9e1a21328e13 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:44.212104 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-8a6f5683-e350-4c4f-b424-a2c9247c8610 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1303 microversion: 2.1 time: 0.144904 Dec 20 03:31:44.221346 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 228/442] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:44 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1303 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:44.261958 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-2543fee8-edc2-4f4c-b0de-e2c6fcb72e1c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:31:44.263139 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-2543fee8-edc2-4f4c-b0de-e2c6fcb72e1c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:44.269782 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2543fee8-edc2-4f4c-b0de-e2c6fcb72e1c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:44.270277 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2543fee8-edc2-4f4c-b0de-e2c6fcb72e1c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:44.271205 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2543fee8-edc2-4f4c-b0de-e2c6fcb72e1c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:44.271649 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2543fee8-edc2-4f4c-b0de-e2c6fcb72e1c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:44.300571 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.objects.instance [None req-2543fee8-edc2-4f4c-b0de-e2c6fcb72e1c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lazy-loading 'flavor' on Instance uuid 4e5cfe95-9804-4406-a893-82b021de3826 {{(pid=117011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:31:44.413063 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-12d093c6-6b1a-4563-a2cc-9e1a21328e13 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:44.421652 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-12d093c6-6b1a-4563-a2cc-9e1a21328e13 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9" status: 200 len: 1319 microversion: 2.1 time: 0.244840 Dec 20 03:31:44.422287 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 215/443] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:44 2021] GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:44.738541 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-2543fee8-edc2-4f4c-b0de-e2c6fcb72e1c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "POST /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/action" status: 200 len: 32 microversion: 2.1 time: 0.480840 Dec 20 03:31:44.739611 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 229/444] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:31:44 2021] POST /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/action => generated 32 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 20 03:31:44.749848 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-2b02c964-d031-4e42-b8ad-e29cc313454a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:44.750492 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-2b02c964-d031-4e42-b8ad-e29cc313454a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:44.756955 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2b02c964-d031-4e42-b8ad-e29cc313454a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:44.758037 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2b02c964-d031-4e42-b8ad-e29cc313454a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:44.758867 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2b02c964-d031-4e42-b8ad-e29cc313454a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:44.759317 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2b02c964-d031-4e42-b8ad-e29cc313454a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:44.917563 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-2b02c964-d031-4e42-b8ad-e29cc313454a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:44.930954 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-2b02c964-d031-4e42-b8ad-e29cc313454a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.185189 Dec 20 03:31:44.931662 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 216/445] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:44 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:45.193367 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e1b31580-cbcc-4ec0-a164-d1069015be3f tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:45.195067 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e1b31580-cbcc-4ec0-a164-d1069015be3f tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:45.202387 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e1b31580-cbcc-4ec0-a164-d1069015be3f tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:45.203221 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e1b31580-cbcc-4ec0-a164-d1069015be3f tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:45.204315 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e1b31580-cbcc-4ec0-a164-d1069015be3f tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:45.205168 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e1b31580-cbcc-4ec0-a164-d1069015be3f tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:45.232213 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-2cb150a2-72b4-4ba5-a9ae-972c0d166ba8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:45.233637 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-2cb150a2-72b4-4ba5-a9ae-972c0d166ba8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:45.245806 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2cb150a2-72b4-4ba5-a9ae-972c0d166ba8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:45.246522 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2cb150a2-72b4-4ba5-a9ae-972c0d166ba8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:45.248760 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2cb150a2-72b4-4ba5-a9ae-972c0d166ba8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:45.251289 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2cb150a2-72b4-4ba5-a9ae-972c0d166ba8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:45.293429 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2cb150a2-72b4-4ba5-a9ae-972c0d166ba8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:45.293888 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2cb150a2-72b4-4ba5-a9ae-972c0d166ba8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:45.294351 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.objects.instance [None req-2cb150a2-72b4-4ba5-a9ae-972c0d166ba8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lazy-loading 'fault' on Instance uuid c34f5947-d72d-47ad-992f-d7b79c785841 {{(pid=117012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:31:45.358840 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-2cb150a2-72b4-4ba5-a9ae-972c0d166ba8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:45.368752 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-2cb150a2-72b4-4ba5-a9ae-972c0d166ba8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 200 len: 1308 microversion: 2.1 time: 0.140103 Dec 20 03:31:45.370523 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 217/446] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:45 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 1308 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:45.444196 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-59939a9f-1097-46ed-98c9-d0c2c40c9aa9 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:45.446667 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-59939a9f-1097-46ed-98c9-d0c2c40c9aa9 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:45.484409 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-59939a9f-1097-46ed-98c9-d0c2c40c9aa9 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:45.485274 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-59939a9f-1097-46ed-98c9-d0c2c40c9aa9 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:45.486830 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-59939a9f-1097-46ed-98c9-d0c2c40c9aa9 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:45.487623 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-59939a9f-1097-46ed-98c9-d0c2c40c9aa9 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:45.785654 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-59939a9f-1097-46ed-98c9-d0c2c40c9aa9 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:45.803397 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-59939a9f-1097-46ed-98c9-d0c2c40c9aa9 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9" status: 200 len: 1319 microversion: 2.1 time: 0.365968 Dec 20 03:31:45.806829 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-e1b31580-cbcc-4ec0-a164-d1069015be3f tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0125545010294077a700465430c13b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6866bc2e71464c7899f85564f604f7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:45.817676 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 218/447] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:45 2021] GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:45.830705 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e1b31580-cbcc-4ec0-a164-d1069015be3f tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 200 len: 1471 microversion: 2.1 time: 0.641569 Dec 20 03:31:45.832725 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 230/448] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:45 2021] GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 1471 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:45.950571 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-fccfcd4e-0409-4405-968a-70eaf8ad26c7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:45.951183 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-fccfcd4e-0409-4405-968a-70eaf8ad26c7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:45.957189 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fccfcd4e-0409-4405-968a-70eaf8ad26c7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:45.957646 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fccfcd4e-0409-4405-968a-70eaf8ad26c7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:45.965241 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fccfcd4e-0409-4405-968a-70eaf8ad26c7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:45.965241 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fccfcd4e-0409-4405-968a-70eaf8ad26c7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:46.157071 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-fca4bdf2-9d65-4765-9209-57ad89d8e271 req-4d2fc895-c088-4ca6-9dad-e81fa711467c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5578527e-afe7-41bb-95f2-be172e989cab", "name": "network-vif-deleted", "tag": "67ca6f6d-dd2b-40ae-b96e-83723598480b"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:31:46.159430 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:31:46.159430 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:31:46.167420 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-fca4bdf2-9d65-4765-9209-57ad89d8e271 req-4d2fc895-c088-4ca6-9dad-e81fa711467c service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:46.167863 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-fca4bdf2-9d65-4765-9209-57ad89d8e271 req-4d2fc895-c088-4ca6-9dad-e81fa711467c service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:46.193005 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-fca4bdf2-9d65-4765-9209-57ad89d8e271 req-4d2fc895-c088-4ca6-9dad-e81fa711467c service nova] Creating event network-vif-deleted:67ca6f6d-dd2b-40ae-b96e-83723598480b for instance 5578527e-afe7-41bb-95f2-be172e989cab on hv-cinder-81803 Dec 20 03:31:46.199325 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-fca4bdf2-9d65-4765-9209-57ad89d8e271 req-4d2fc895-c088-4ca6-9dad-e81fa711467c service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046883 Dec 20 03:31:46.200963 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 231/449] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:31:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:31:46.260604 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-fccfcd4e-0409-4405-968a-70eaf8ad26c7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:46.269638 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-fccfcd4e-0409-4405-968a-70eaf8ad26c7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.322682 Dec 20 03:31:46.270335 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 219/450] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:45 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:46.388658 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-bde4b53a-8190-4f32-98d7-5934fa68ef3c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:46.389539 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-bde4b53a-8190-4f32-98d7-5934fa68ef3c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: c34f5947-d72d-47ad-992f-d7b79c785841] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:46.396018 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bde4b53a-8190-4f32-98d7-5934fa68ef3c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:46.396468 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bde4b53a-8190-4f32-98d7-5934fa68ef3c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:46.397818 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bde4b53a-8190-4f32-98d7-5934fa68ef3c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:46.398461 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bde4b53a-8190-4f32-98d7-5934fa68ef3c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:46.412322 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-bde4b53a-8190-4f32-98d7-5934fa68ef3c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] HTTP exception thrown: Instance c34f5947-d72d-47ad-992f-d7b79c785841 could not be found. Dec 20 03:31:46.412920 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-bde4b53a-8190-4f32-98d7-5934fa68ef3c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Returning 404 to user: Instance c34f5947-d72d-47ad-992f-d7b79c785841 could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:31:46.413827 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-bde4b53a-8190-4f32-98d7-5934fa68ef3c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841" status: 404 len: 111 microversion: 2.1 time: 0.029706 Dec 20 03:31:46.414482 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 232/451] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:46 2021] GET /compute/v2.1/servers/c34f5947-d72d-47ad-992f-d7b79c785841 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:31:46.829870 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-5f56cf2a-69d3-459c-b1b7-3a6d3e2f6c0f tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:46.830621 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-5f56cf2a-69d3-459c-b1b7-3a6d3e2f6c0f tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:46.838897 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5f56cf2a-69d3-459c-b1b7-3a6d3e2f6c0f tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:46.844742 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5f56cf2a-69d3-459c-b1b7-3a6d3e2f6c0f tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:46.844742 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5f56cf2a-69d3-459c-b1b7-3a6d3e2f6c0f tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:46.844742 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5f56cf2a-69d3-459c-b1b7-3a6d3e2f6c0f tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:46.853945 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1ebf23f1-b6fa-469c-a704-633539dbb1e7 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:46.854995 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1ebf23f1-b6fa-469c-a704-633539dbb1e7 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:46.864856 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1ebf23f1-b6fa-469c-a704-633539dbb1e7 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:46.865630 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1ebf23f1-b6fa-469c-a704-633539dbb1e7 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:46.867949 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1ebf23f1-b6fa-469c-a704-633539dbb1e7 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:46.868676 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1ebf23f1-b6fa-469c-a704-633539dbb1e7 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:46.919944 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1ebf23f1-b6fa-469c-a704-633539dbb1e7 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:46.920756 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1ebf23f1-b6fa-469c-a704-633539dbb1e7 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:46.921589 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.objects.instance [None req-1ebf23f1-b6fa-469c-a704-633539dbb1e7 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lazy-loading 'fault' on Instance uuid 5578527e-afe7-41bb-95f2-be172e989cab {{(pid=117011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:31:47.033328 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-5f56cf2a-69d3-459c-b1b7-3a6d3e2f6c0f tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:47.043843 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-1ebf23f1-b6fa-469c-a704-633539dbb1e7 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0125545010294077a700465430c13b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6866bc2e71464c7899f85564f604f7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:47.045572 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-5f56cf2a-69d3-459c-b1b7-3a6d3e2f6c0f tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9" status: 200 len: 1319 microversion: 2.1 time: 0.219449 Dec 20 03:31:47.046166 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 220/452] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:46 2021] GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:47.057757 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1ebf23f1-b6fa-469c-a704-633539dbb1e7 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 200 len: 1305 microversion: 2.1 time: 0.210500 Dec 20 03:31:47.059017 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 233/453] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:46 2021] GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 1305 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:47.288221 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-23abd543-0a41-40de-a928-a5e0e05961d1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:47.289058 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-23abd543-0a41-40de-a928-a5e0e05961d1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:47.297319 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-23abd543-0a41-40de-a928-a5e0e05961d1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:47.298075 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-23abd543-0a41-40de-a928-a5e0e05961d1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:47.299069 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-23abd543-0a41-40de-a928-a5e0e05961d1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:47.299762 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-23abd543-0a41-40de-a928-a5e0e05961d1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:47.469586 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-23abd543-0a41-40de-a928-a5e0e05961d1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:47.478331 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-23abd543-0a41-40de-a928-a5e0e05961d1 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.194558 Dec 20 03:31:47.478920 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 221/454] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:47 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:47.738448 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-98a1e402-60eb-49b8-84b9-214c6b7259d0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:47.739161 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-98a1e402-60eb-49b8-84b9-214c6b7259d0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:47.747312 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-98a1e402-60eb-49b8-84b9-214c6b7259d0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:47.747761 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-98a1e402-60eb-49b8-84b9-214c6b7259d0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:47.748555 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-98a1e402-60eb-49b8-84b9-214c6b7259d0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:47.748990 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-98a1e402-60eb-49b8-84b9-214c6b7259d0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:47.776699 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-98a1e402-60eb-49b8-84b9-214c6b7259d0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Going to try to terminate instance {{(pid=117011) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:31:48.068064 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-4140d262-0c8a-482e-a93a-a7819b32e92e tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:48.068597 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-4140d262-0c8a-482e-a93a-a7819b32e92e tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:48.077425 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4140d262-0c8a-482e-a93a-a7819b32e92e tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:48.078025 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4140d262-0c8a-482e-a93a-a7819b32e92e tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:48.079005 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4140d262-0c8a-482e-a93a-a7819b32e92e tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:48.079654 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4140d262-0c8a-482e-a93a-a7819b32e92e tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:48.248361 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-4140d262-0c8a-482e-a93a-a7819b32e92e tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:48.256098 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-4140d262-0c8a-482e-a93a-a7819b32e92e tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9" status: 200 len: 1319 microversion: 2.1 time: 0.191981 Dec 20 03:31:48.256677 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 222/455] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:48 2021] GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:48.261996 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-cec5b38f-2b1e-454b-8097-8ad05b3e53f3 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:48.262721 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-cec5b38f-2b1e-454b-8097-8ad05b3e53f3 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] [instance: 5578527e-afe7-41bb-95f2-be172e989cab] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:48.269097 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cec5b38f-2b1e-454b-8097-8ad05b3e53f3 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:48.269734 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cec5b38f-2b1e-454b-8097-8ad05b3e53f3 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:48.270538 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cec5b38f-2b1e-454b-8097-8ad05b3e53f3 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:48.270976 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cec5b38f-2b1e-454b-8097-8ad05b3e53f3 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:48.286040 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-cec5b38f-2b1e-454b-8097-8ad05b3e53f3 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] HTTP exception thrown: Instance 5578527e-afe7-41bb-95f2-be172e989cab could not be found. Dec 20 03:31:48.286650 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-cec5b38f-2b1e-454b-8097-8ad05b3e53f3 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] Returning 404 to user: Instance 5578527e-afe7-41bb-95f2-be172e989cab could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:31:48.287484 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-cec5b38f-2b1e-454b-8097-8ad05b3e53f3 tempest-VolumesNegativeTest-414189637 tempest-VolumesNegativeTest-414189637-project] 10.222.0.53 "GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab" status: 404 len: 111 microversion: 2.1 time: 0.029087 Dec 20 03:31:48.288044 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 223/456] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:48 2021] GET /compute/v2.1/servers/5578527e-afe7-41bb-95f2-be172e989cab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:31:48.298184 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-98a1e402-60eb-49b8-84b9-214c6b7259d0 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "DELETE /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 204 len: 0 microversion: 2.1 time: 0.564279 Dec 20 03:31:48.299512 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 234/457] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:31:47 2021] DELETE /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:31:48.318814 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c9d62198-7286-4a92-92c4-799fe90d0157 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:48.320670 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c9d62198-7286-4a92-92c4-799fe90d0157 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:48.336815 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c9d62198-7286-4a92-92c4-799fe90d0157 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:48.337605 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c9d62198-7286-4a92-92c4-799fe90d0157 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:48.339096 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c9d62198-7286-4a92-92c4-799fe90d0157 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:48.340184 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c9d62198-7286-4a92-92c4-799fe90d0157 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:48.501565 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1f5f70eb-b893-4581-b825-35b16dfc415e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:48.502340 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1f5f70eb-b893-4581-b825-35b16dfc415e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:48.512138 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1f5f70eb-b893-4581-b825-35b16dfc415e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:48.512603 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1f5f70eb-b893-4581-b825-35b16dfc415e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:48.513469 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1f5f70eb-b893-4581-b825-35b16dfc415e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:48.514095 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1f5f70eb-b893-4581-b825-35b16dfc415e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:48.572347 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c9d62198-7286-4a92-92c4-799fe90d0157 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:48.581031 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c9d62198-7286-4a92-92c4-799fe90d0157 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 200 len: 1513 microversion: 2.1 time: 0.268656 Dec 20 03:31:48.586846 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 224/458] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:48 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 1513 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:48.597321 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-1eac3eef-952b-456e-8258-2262f2419dce req-a2743558-9063-4bf1-9f96-9d90d668f518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbefc305-fd32-4fa9-9c3a-1c4e53b716b9", "name": "network-vif-plugged", "status": "completed", "tag": "e4415830-c355-4d6e-a000-020a900363fb"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:31:48.599502 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:31:48.599502 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:31:48.609953 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-1eac3eef-952b-456e-8258-2262f2419dce req-a2743558-9063-4bf1-9f96-9d90d668f518 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:48.610479 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-1eac3eef-952b-456e-8258-2262f2419dce req-a2743558-9063-4bf1-9f96-9d90d668f518 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:48.631407 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-1eac3eef-952b-456e-8258-2262f2419dce req-a2743558-9063-4bf1-9f96-9d90d668f518 service nova] Creating event network-vif-plugged:e4415830-c355-4d6e-a000-020a900363fb for instance bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 on hv-cinder-81803 Dec 20 03:31:48.640738 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-1eac3eef-952b-456e-8258-2262f2419dce req-a2743558-9063-4bf1-9f96-9d90d668f518 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051088 Dec 20 03:31:48.641833 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 225/459] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:31:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:31:48.701834 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-1f5f70eb-b893-4581-b825-35b16dfc415e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:48.719692 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1f5f70eb-b893-4581-b825-35b16dfc415e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.225233 Dec 20 03:31:48.735588 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 235/460] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:48 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:49.279074 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e6d09a44-6b13-404d-937b-aa39ea362402 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:49.280079 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e6d09a44-6b13-404d-937b-aa39ea362402 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:49.286728 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e6d09a44-6b13-404d-937b-aa39ea362402 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:49.287316 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e6d09a44-6b13-404d-937b-aa39ea362402 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:49.288709 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e6d09a44-6b13-404d-937b-aa39ea362402 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:49.289313 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e6d09a44-6b13-404d-937b-aa39ea362402 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:49.438292 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-e6d09a44-6b13-404d-937b-aa39ea362402 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:49.446904 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e6d09a44-6b13-404d-937b-aa39ea362402 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9" status: 200 len: 1319 microversion: 2.1 time: 0.174013 Dec 20 03:31:49.453689 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 226/461] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:49 2021] GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:49.605695 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-338271a4-52c7-43c9-9687-d5762775a833 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:49.606507 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-338271a4-52c7-43c9-9687-d5762775a833 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:49.614175 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-338271a4-52c7-43c9-9687-d5762775a833 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:49.614774 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-338271a4-52c7-43c9-9687-d5762775a833 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:49.615736 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-338271a4-52c7-43c9-9687-d5762775a833 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:49.616807 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-338271a4-52c7-43c9-9687-d5762775a833 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:49.744732 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-90a2a0ba-58b7-4289-a7e0-5869e0d8f99b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:49.755914 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-90a2a0ba-58b7-4289-a7e0-5869e0d8f99b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:49.755914 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-90a2a0ba-58b7-4289-a7e0-5869e0d8f99b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:49.755914 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-90a2a0ba-58b7-4289-a7e0-5869e0d8f99b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:49.755914 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-90a2a0ba-58b7-4289-a7e0-5869e0d8f99b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:49.756687 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-90a2a0ba-58b7-4289-a7e0-5869e0d8f99b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:49.775600 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-338271a4-52c7-43c9-9687-d5762775a833 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:49.784439 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-338271a4-52c7-43c9-9687-d5762775a833 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 200 len: 1513 microversion: 2.1 time: 0.183408 Dec 20 03:31:49.785370 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 236/462] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:49 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:49.966886 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-90a2a0ba-58b7-4289-a7e0-5869e0d8f99b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:49.979620 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-90a2a0ba-58b7-4289-a7e0-5869e0d8f99b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.239660 Dec 20 03:31:49.980608 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 227/463] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:49 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:50.468213 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-c398bb43-38b7-46ec-905a-09a92579abd0 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:50.469171 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-c398bb43-38b7-46ec-905a-09a92579abd0 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:50.480793 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c398bb43-38b7-46ec-905a-09a92579abd0 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:50.481974 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c398bb43-38b7-46ec-905a-09a92579abd0 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:50.483748 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c398bb43-38b7-46ec-905a-09a92579abd0 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:50.484792 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c398bb43-38b7-46ec-905a-09a92579abd0 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:50.667425 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-c398bb43-38b7-46ec-905a-09a92579abd0 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:50.679546 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-c398bb43-38b7-46ec-905a-09a92579abd0 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9" status: 200 len: 1319 microversion: 2.1 time: 0.216572 Dec 20 03:31:50.680492 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 237/464] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:50 2021] GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:50.806677 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-160e42e9-bec5-4b1a-b404-854a08fe31c8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:50.808089 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-160e42e9-bec5-4b1a-b404-854a08fe31c8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:50.816812 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-160e42e9-bec5-4b1a-b404-854a08fe31c8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:50.817486 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-160e42e9-bec5-4b1a-b404-854a08fe31c8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:50.818535 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-160e42e9-bec5-4b1a-b404-854a08fe31c8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:50.819047 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-160e42e9-bec5-4b1a-b404-854a08fe31c8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:51.014900 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-c6672e66-19ef-48b1-909e-e2e24197a5db tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:51.016272 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-c6672e66-19ef-48b1-909e-e2e24197a5db tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:51.048558 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c6672e66-19ef-48b1-909e-e2e24197a5db tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:51.057339 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c6672e66-19ef-48b1-909e-e2e24197a5db tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:51.057339 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c6672e66-19ef-48b1-909e-e2e24197a5db tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:51.057339 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c6672e66-19ef-48b1-909e-e2e24197a5db tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:51.286665 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-160e42e9-bec5-4b1a-b404-854a08fe31c8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:51.286665 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-160e42e9-bec5-4b1a-b404-854a08fe31c8 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 200 len: 1513 microversion: 2.1 time: 0.481785 Dec 20 03:31:51.286665 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 228/465] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:50 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 1513 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:51.353986 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-c6672e66-19ef-48b1-909e-e2e24197a5db tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:51.361925 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-c6672e66-19ef-48b1-909e-e2e24197a5db tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.358028 Dec 20 03:31:51.362586 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 238/466] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:51 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:51.705743 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f2949035-b3c5-495d-a61d-944e7a6f3a27 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:51.707541 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f2949035-b3c5-495d-a61d-944e7a6f3a27 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:51.726098 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f2949035-b3c5-495d-a61d-944e7a6f3a27 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:51.730114 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f2949035-b3c5-495d-a61d-944e7a6f3a27 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:51.731305 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f2949035-b3c5-495d-a61d-944e7a6f3a27 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:51.731792 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f2949035-b3c5-495d-a61d-944e7a6f3a27 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:51.857958 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-308de331-0ecb-4124-817d-4dd4ec4055d5 req-ade4160a-5614-4f43-9e94-367ed3e29222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69cdeced-dc70-4b1b-826b-fc1e794fff2b", "name": "network-vif-deleted", "tag": "0b3b2e1a-633d-4f16-a381-3c86b11ddb3f"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:31:51.862276 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:31:51.862276 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:31:51.875594 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-308de331-0ecb-4124-817d-4dd4ec4055d5 req-ade4160a-5614-4f43-9e94-367ed3e29222 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:51.876795 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-308de331-0ecb-4124-817d-4dd4ec4055d5 req-ade4160a-5614-4f43-9e94-367ed3e29222 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:51.902657 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-308de331-0ecb-4124-817d-4dd4ec4055d5 req-ade4160a-5614-4f43-9e94-367ed3e29222 service nova] Creating event network-vif-deleted:0b3b2e1a-633d-4f16-a381-3c86b11ddb3f for instance 69cdeced-dc70-4b1b-826b-fc1e794fff2b on hv-cinder-81803 Dec 20 03:31:51.930639 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-308de331-0ecb-4124-817d-4dd4ec4055d5 req-ade4160a-5614-4f43-9e94-367ed3e29222 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081298 Dec 20 03:31:51.937678 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 239/467] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:31:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:31:52.007886 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-f2949035-b3c5-495d-a61d-944e7a6f3a27 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:52.024067 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f2949035-b3c5-495d-a61d-944e7a6f3a27 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9" status: 200 len: 1509 microversion: 2.1 time: 0.329172 Dec 20 03:31:52.025281 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 229/468] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:51 2021] GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 => generated 1509 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:52.306130 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-9a214bcd-145d-4fda-abc2-7d0e30a3e347 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:52.309702 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-9a214bcd-145d-4fda-abc2-7d0e30a3e347 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:52.325102 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9a214bcd-145d-4fda-abc2-7d0e30a3e347 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:52.327247 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9a214bcd-145d-4fda-abc2-7d0e30a3e347 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:52.328861 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9a214bcd-145d-4fda-abc2-7d0e30a3e347 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:52.330134 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9a214bcd-145d-4fda-abc2-7d0e30a3e347 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:52.384353 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-6844da62-aaba-4f86-9cae-cc8024a45dec tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:52.385818 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6844da62-aaba-4f86-9cae-cc8024a45dec tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:52.391991 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9a214bcd-145d-4fda-abc2-7d0e30a3e347 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:52.392427 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9a214bcd-145d-4fda-abc2-7d0e30a3e347 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:52.392933 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.objects.instance [None req-9a214bcd-145d-4fda-abc2-7d0e30a3e347 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lazy-loading 'fault' on Instance uuid 69cdeced-dc70-4b1b-826b-fc1e794fff2b {{(pid=117011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:31:52.395665 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6844da62-aaba-4f86-9cae-cc8024a45dec tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:52.396124 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6844da62-aaba-4f86-9cae-cc8024a45dec tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:52.398192 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6844da62-aaba-4f86-9cae-cc8024a45dec tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:52.399158 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6844da62-aaba-4f86-9cae-cc8024a45dec tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:52.464413 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9a214bcd-145d-4fda-abc2-7d0e30a3e347 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:52.490413 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-9a214bcd-145d-4fda-abc2-7d0e30a3e347 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 200 len: 1307 microversion: 2.1 time: 0.193211 Dec 20 03:31:52.492539 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 240/469] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:52 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 1307 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:52.605126 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-6844da62-aaba-4f86-9cae-cc8024a45dec tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:52.613682 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-6844da62-aaba-4f86-9cae-cc8024a45dec tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.236629 Dec 20 03:31:52.614264 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 230/470] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:52 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:53.518083 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-cdfbebcb-9580-4a85-8ce3-ee2df0d46238 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:53.518791 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-cdfbebcb-9580-4a85-8ce3-ee2df0d46238 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 69cdeced-dc70-4b1b-826b-fc1e794fff2b] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:53.526194 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-cdfbebcb-9580-4a85-8ce3-ee2df0d46238 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:53.539569 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-cdfbebcb-9580-4a85-8ce3-ee2df0d46238 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:53.539569 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-cdfbebcb-9580-4a85-8ce3-ee2df0d46238 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:53.539569 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-cdfbebcb-9580-4a85-8ce3-ee2df0d46238 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:53.542873 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-cdfbebcb-9580-4a85-8ce3-ee2df0d46238 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] HTTP exception thrown: Instance 69cdeced-dc70-4b1b-826b-fc1e794fff2b could not be found. Dec 20 03:31:53.543478 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-cdfbebcb-9580-4a85-8ce3-ee2df0d46238 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Returning 404 to user: Instance 69cdeced-dc70-4b1b-826b-fc1e794fff2b could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:31:53.544322 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-cdfbebcb-9580-4a85-8ce3-ee2df0d46238 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b" status: 404 len: 111 microversion: 2.1 time: 0.030648 Dec 20 03:31:53.544888 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 241/471] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:53 2021] GET /compute/v2.1/servers/69cdeced-dc70-4b1b-826b-fc1e794fff2b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:31:53.553320 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d1252e3c-92d1-412c-8e67-f89896b4a0cd tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:53.555017 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d1252e3c-92d1-412c-8e67-f89896b4a0cd tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:53.561710 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d1252e3c-92d1-412c-8e67-f89896b4a0cd tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:53.562165 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d1252e3c-92d1-412c-8e67-f89896b4a0cd tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:53.562993 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d1252e3c-92d1-412c-8e67-f89896b4a0cd tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:53.563403 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d1252e3c-92d1-412c-8e67-f89896b4a0cd tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:53.593175 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d1252e3c-92d1-412c-8e67-f89896b4a0cd tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Going to try to terminate instance {{(pid=117012) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:31:53.636151 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-207253d8-6140-4bea-a896-86a1c432d137 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:53.637460 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-207253d8-6140-4bea-a896-86a1c432d137 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:53.646719 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-207253d8-6140-4bea-a896-86a1c432d137 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:53.647292 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-207253d8-6140-4bea-a896-86a1c432d137 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:53.648655 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-207253d8-6140-4bea-a896-86a1c432d137 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:53.649101 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-207253d8-6140-4bea-a896-86a1c432d137 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:53.902493 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-207253d8-6140-4bea-a896-86a1c432d137 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:53.918015 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-207253d8-6140-4bea-a896-86a1c432d137 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.289220 Dec 20 03:31:53.918905 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 242/472] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:53 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:31:54.011161 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d1252e3c-92d1-412c-8e67-f89896b4a0cd tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "DELETE /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 204 len: 0 microversion: 2.1 time: 0.452865 Dec 20 03:31:54.011161 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 231/473] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:31:53 2021] DELETE /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 20 03:31:54.021596 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f9939cdf-b034-47b8-bf71-e1ca873a8964 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:54.022798 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-f9939cdf-b034-47b8-bf71-e1ca873a8964 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:54.039565 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f9939cdf-b034-47b8-bf71-e1ca873a8964 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:54.039565 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f9939cdf-b034-47b8-bf71-e1ca873a8964 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:54.039565 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f9939cdf-b034-47b8-bf71-e1ca873a8964 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:54.039565 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f9939cdf-b034-47b8-bf71-e1ca873a8964 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:54.234497 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-f9939cdf-b034-47b8-bf71-e1ca873a8964 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:54.244875 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f9939cdf-b034-47b8-bf71-e1ca873a8964 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1514 microversion: 2.1 time: 0.230887 Dec 20 03:31:54.246072 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 243/474] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:54 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:54.950625 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-02128e50-914e-49e8-a262-c819fef17f5f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:54.960597 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-02128e50-914e-49e8-a262-c819fef17f5f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:54.966650 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-02128e50-914e-49e8-a262-c819fef17f5f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:54.967104 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-02128e50-914e-49e8-a262-c819fef17f5f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:54.967912 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-02128e50-914e-49e8-a262-c819fef17f5f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:54.968351 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-02128e50-914e-49e8-a262-c819fef17f5f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:55.188348 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-02128e50-914e-49e8-a262-c819fef17f5f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:55.198034 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-02128e50-914e-49e8-a262-c819fef17f5f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.256743 Dec 20 03:31:55.198641 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 232/475] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:54 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:55.270722 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-c800c9e6-bfa2-4bfa-80dc-2ac007d2853d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:55.272161 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-c800c9e6-bfa2-4bfa-80dc-2ac007d2853d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:55.280294 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c800c9e6-bfa2-4bfa-80dc-2ac007d2853d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:55.281216 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c800c9e6-bfa2-4bfa-80dc-2ac007d2853d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:55.282747 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c800c9e6-bfa2-4bfa-80dc-2ac007d2853d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:55.283387 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c800c9e6-bfa2-4bfa-80dc-2ac007d2853d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:55.536584 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-c800c9e6-bfa2-4bfa-80dc-2ac007d2853d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:55.549390 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-c800c9e6-bfa2-4bfa-80dc-2ac007d2853d tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1514 microversion: 2.1 time: 0.282258 Dec 20 03:31:55.551187 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 244/476] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:55 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1514 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:56.223521 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-73472354-1a91-4793-b71d-52ffa23e20ad tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:56.234421 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-73472354-1a91-4793-b71d-52ffa23e20ad tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:56.261030 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-73472354-1a91-4793-b71d-52ffa23e20ad tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:56.266219 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-73472354-1a91-4793-b71d-52ffa23e20ad tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:56.266219 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-73472354-1a91-4793-b71d-52ffa23e20ad tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:56.266219 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-73472354-1a91-4793-b71d-52ffa23e20ad tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:56.585559 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d27c037e-e2a5-46d8-a998-70b51d1204aa tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:56.589796 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d27c037e-e2a5-46d8-a998-70b51d1204aa tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:56.605773 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d27c037e-e2a5-46d8-a998-70b51d1204aa tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:56.607779 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d27c037e-e2a5-46d8-a998-70b51d1204aa tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:56.610140 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d27c037e-e2a5-46d8-a998-70b51d1204aa tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:56.611400 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d27c037e-e2a5-46d8-a998-70b51d1204aa tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:56.718904 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-73472354-1a91-4793-b71d-52ffa23e20ad tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:56.732106 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-73472354-1a91-4793-b71d-52ffa23e20ad tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.515973 Dec 20 03:31:56.733449 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 233/477] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:56 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:57.048581 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d27c037e-e2a5-46d8-a998-70b51d1204aa tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:57.072418 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d27c037e-e2a5-46d8-a998-70b51d1204aa tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1514 microversion: 2.1 time: 0.493880 Dec 20 03:31:57.073821 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 245/478] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:56 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1514 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:57.088436 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-67588c4e-7d36-4c49-ba2e-1dc0f3f6d8d6 req-05a924c2-0b26-4589-9f82-6e3ac455193a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "193a15ec-d618-4edf-967c-09b3ccc4069e", "name": "network-vif-deleted", "tag": "27cdf226-e684-4867-9d0a-236f8a22a8f4"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:31:57.099710 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:31:57.099710 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:31:57.109468 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-67588c4e-7d36-4c49-ba2e-1dc0f3f6d8d6 req-05a924c2-0b26-4589-9f82-6e3ac455193a service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:57.110025 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-67588c4e-7d36-4c49-ba2e-1dc0f3f6d8d6 req-05a924c2-0b26-4589-9f82-6e3ac455193a service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:57.123921 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-67588c4e-7d36-4c49-ba2e-1dc0f3f6d8d6 req-05a924c2-0b26-4589-9f82-6e3ac455193a service nova] Creating event network-vif-deleted:27cdf226-e684-4867-9d0a-236f8a22a8f4 for instance 193a15ec-d618-4edf-967c-09b3ccc4069e on hv-cinder-81803 Dec 20 03:31:57.131451 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-67588c4e-7d36-4c49-ba2e-1dc0f3f6d8d6 req-05a924c2-0b26-4589-9f82-6e3ac455193a service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051730 Dec 20 03:31:57.135212 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 234/479] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:31:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:31:57.758295 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ba650dc1-4bd9-4de2-9b39-c37e75a17ad7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:57.761084 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ba650dc1-4bd9-4de2-9b39-c37e75a17ad7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:57.790894 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ba650dc1-4bd9-4de2-9b39-c37e75a17ad7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:57.792012 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ba650dc1-4bd9-4de2-9b39-c37e75a17ad7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:57.794808 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ba650dc1-4bd9-4de2-9b39-c37e75a17ad7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:57.795923 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ba650dc1-4bd9-4de2-9b39-c37e75a17ad7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:58.041042 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ba650dc1-4bd9-4de2-9b39-c37e75a17ad7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:58.057892 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ba650dc1-4bd9-4de2-9b39-c37e75a17ad7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.309604 Dec 20 03:31:58.060561 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 246/480] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:57 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:58.092411 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-4c6eda4c-eaeb-4c09-bf8a-fd31cd35d461 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:58.093857 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-4c6eda4c-eaeb-4c09-bf8a-fd31cd35d461 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:58.122436 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4c6eda4c-eaeb-4c09-bf8a-fd31cd35d461 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:58.122436 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4c6eda4c-eaeb-4c09-bf8a-fd31cd35d461 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:58.122436 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4c6eda4c-eaeb-4c09-bf8a-fd31cd35d461 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:58.122436 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4c6eda4c-eaeb-4c09-bf8a-fd31cd35d461 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:58.175748 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4c6eda4c-eaeb-4c09-bf8a-fd31cd35d461 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:58.176217 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4c6eda4c-eaeb-4c09-bf8a-fd31cd35d461 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:58.177622 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.objects.instance [None req-4c6eda4c-eaeb-4c09-bf8a-fd31cd35d461 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lazy-loading 'fault' on Instance uuid 193a15ec-d618-4edf-967c-09b3ccc4069e {{(pid=117012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:31:58.244718 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-4c6eda4c-eaeb-4c09-bf8a-fd31cd35d461 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:58.256446 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-4c6eda4c-eaeb-4c09-bf8a-fd31cd35d461 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 200 len: 1308 microversion: 2.1 time: 0.168603 Dec 20 03:31:58.258538 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 235/481] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:58 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 1308 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:31:59.095322 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-87f56b67-399b-450f-96fd-54f63027c180 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:59.096383 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-87f56b67-399b-450f-96fd-54f63027c180 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:59.112696 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-87f56b67-399b-450f-96fd-54f63027c180 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:59.113603 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-87f56b67-399b-450f-96fd-54f63027c180 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:59.115074 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-87f56b67-399b-450f-96fd-54f63027c180 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:59.115889 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-87f56b67-399b-450f-96fd-54f63027c180 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:59.276177 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-4995d446-9c0b-4ab6-b8e9-35e10087708c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:31:59.276944 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-4995d446-9c0b-4ab6-b8e9-35e10087708c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: 193a15ec-d618-4edf-967c-09b3ccc4069e] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:31:59.293072 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4995d446-9c0b-4ab6-b8e9-35e10087708c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:59.293680 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4995d446-9c0b-4ab6-b8e9-35e10087708c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:59.295445 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4995d446-9c0b-4ab6-b8e9-35e10087708c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:31:59.296108 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4995d446-9c0b-4ab6-b8e9-35e10087708c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:31:59.327958 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-4995d446-9c0b-4ab6-b8e9-35e10087708c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] HTTP exception thrown: Instance 193a15ec-d618-4edf-967c-09b3ccc4069e could not be found. Dec 20 03:31:59.328884 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-4995d446-9c0b-4ab6-b8e9-35e10087708c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Returning 404 to user: Instance 193a15ec-d618-4edf-967c-09b3ccc4069e could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:31:59.333581 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-4995d446-9c0b-4ab6-b8e9-35e10087708c tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e" status: 404 len: 111 microversion: 2.1 time: 0.062133 Dec 20 03:31:59.335323 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 236/482] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:59 2021] GET /compute/v2.1/servers/193a15ec-d618-4edf-967c-09b3ccc4069e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:31:59.356936 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-87f56b67-399b-450f-96fd-54f63027c180 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:31:59.367155 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-87f56b67-399b-450f-96fd-54f63027c180 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.293877 Dec 20 03:31:59.378833 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 247/483] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:31:59 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:00.387572 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-9133a7b1-2dfd-49c1-a005-54d12eb3c6b2 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:00.396492 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-9133a7b1-2dfd-49c1-a005-54d12eb3c6b2 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:00.422947 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9133a7b1-2dfd-49c1-a005-54d12eb3c6b2 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:00.424119 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9133a7b1-2dfd-49c1-a005-54d12eb3c6b2 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:00.426655 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9133a7b1-2dfd-49c1-a005-54d12eb3c6b2 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:00.427722 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9133a7b1-2dfd-49c1-a005-54d12eb3c6b2 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:00.746125 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-9133a7b1-2dfd-49c1-a005-54d12eb3c6b2 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:00.763152 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-9133a7b1-2dfd-49c1-a005-54d12eb3c6b2 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.381986 Dec 20 03:32:00.787636 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 237/484] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:00 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:00.894069 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ec7fafda-78b8-435e-b965-59b18c63fd40 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:00.897620 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ec7fafda-78b8-435e-b965-59b18c63fd40 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:00.924227 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ec7fafda-78b8-435e-b965-59b18c63fd40 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:00.925667 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ec7fafda-78b8-435e-b965-59b18c63fd40 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:00.933988 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ec7fafda-78b8-435e-b965-59b18c63fd40 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:00.936272 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ec7fafda-78b8-435e-b965-59b18c63fd40 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:00.991495 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ec7fafda-78b8-435e-b965-59b18c63fd40 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Going to try to terminate instance {{(pid=117011) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:32:01.362590 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ec7fafda-78b8-435e-b965-59b18c63fd40 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "DELETE /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 204 len: 0 microversion: 2.1 time: 0.479732 Dec 20 03:32:01.366849 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 248/485] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:32:00 2021] DELETE /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:32:01.376888 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-021c52ef-a7f1-4932-9e7d-641577563ad5 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:01.377803 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-021c52ef-a7f1-4932-9e7d-641577563ad5 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:01.405213 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-021c52ef-a7f1-4932-9e7d-641577563ad5 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:01.405817 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-021c52ef-a7f1-4932-9e7d-641577563ad5 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:01.410377 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-021c52ef-a7f1-4932-9e7d-641577563ad5 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:01.411621 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-021c52ef-a7f1-4932-9e7d-641577563ad5 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:01.690391 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-021c52ef-a7f1-4932-9e7d-641577563ad5 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:01.717096 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-021c52ef-a7f1-4932-9e7d-641577563ad5 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1514 microversion: 2.1 time: 0.343782 Dec 20 03:32:01.719825 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 238/486] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:01 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1514 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:01.808022 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-049f45c2-9f65-446f-83df-41309acdb874 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:01.808873 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-049f45c2-9f65-446f-83df-41309acdb874 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:01.822245 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-049f45c2-9f65-446f-83df-41309acdb874 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:01.823046 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-049f45c2-9f65-446f-83df-41309acdb874 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:01.824494 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-049f45c2-9f65-446f-83df-41309acdb874 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:01.826057 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-049f45c2-9f65-446f-83df-41309acdb874 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:02.056610 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-049f45c2-9f65-446f-83df-41309acdb874 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:02.075382 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-049f45c2-9f65-446f-83df-41309acdb874 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.278186 Dec 20 03:32:02.076211 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 249/487] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:01 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:02.751247 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-92cd0b74-de40-4325-ac02-47ea09314f02 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:02.751969 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-92cd0b74-de40-4325-ac02-47ea09314f02 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:02.766985 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-92cd0b74-de40-4325-ac02-47ea09314f02 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:02.767465 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-92cd0b74-de40-4325-ac02-47ea09314f02 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:02.768303 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-92cd0b74-de40-4325-ac02-47ea09314f02 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:02.769666 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-92cd0b74-de40-4325-ac02-47ea09314f02 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:03.100752 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-8f504bc4-66be-441c-aa1b-c5e532a5a602 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:03.107591 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-8f504bc4-66be-441c-aa1b-c5e532a5a602 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:03.125854 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8f504bc4-66be-441c-aa1b-c5e532a5a602 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:03.126591 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8f504bc4-66be-441c-aa1b-c5e532a5a602 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:03.131344 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8f504bc4-66be-441c-aa1b-c5e532a5a602 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:03.131344 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8f504bc4-66be-441c-aa1b-c5e532a5a602 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:03.223910 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-92cd0b74-de40-4325-ac02-47ea09314f02 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:03.232875 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-92cd0b74-de40-4325-ac02-47ea09314f02 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1514 microversion: 2.1 time: 0.488830 Dec 20 03:32:03.234084 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 239/488] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:02 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1514 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:03.410823 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-8f504bc4-66be-441c-aa1b-c5e532a5a602 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:03.426055 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-8f504bc4-66be-441c-aa1b-c5e532a5a602 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.332543 Dec 20 03:32:03.427973 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 250/489] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:03 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:04.265094 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-56c7f102-be37-4ba7-8734-30a7dcedb3be tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:04.269534 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-56c7f102-be37-4ba7-8734-30a7dcedb3be tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:04.290413 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-56c7f102-be37-4ba7-8734-30a7dcedb3be tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:04.290812 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-56c7f102-be37-4ba7-8734-30a7dcedb3be tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:04.313002 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-56c7f102-be37-4ba7-8734-30a7dcedb3be tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:04.313679 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-56c7f102-be37-4ba7-8734-30a7dcedb3be tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:04.470359 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-32749f62-82e5-4b13-b870-656e8a07c68a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:04.474179 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-32749f62-82e5-4b13-b870-656e8a07c68a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:04.496775 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-32749f62-82e5-4b13-b870-656e8a07c68a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:04.509480 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-32749f62-82e5-4b13-b870-656e8a07c68a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:04.511061 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-32749f62-82e5-4b13-b870-656e8a07c68a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:04.515817 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-32749f62-82e5-4b13-b870-656e8a07c68a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:04.868907 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-56c7f102-be37-4ba7-8734-30a7dcedb3be tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:04.871754 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-32749f62-82e5-4b13-b870-656e8a07c68a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:04.878139 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-56c7f102-be37-4ba7-8734-30a7dcedb3be tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1514 microversion: 2.1 time: 0.621435 Dec 20 03:32:04.878729 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 240/490] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:04 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1514 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:04.889770 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-32749f62-82e5-4b13-b870-656e8a07c68a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.447573 Dec 20 03:32:04.890671 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 251/491] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:04 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:05.848268 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-b50b4456-ca6e-42f8-b6bb-e9d1711b850d req-e7491722-a8d0-4c8c-9ea6-689065e49551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d04a54-3696-41b9-95d8-aa2624b21b17", "name": "network-vif-deleted", "tag": "aa010647-2532-4b5c-ba09-88875560b47b"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:32:05.850024 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:32:05.850024 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:32:05.861566 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-b50b4456-ca6e-42f8-b6bb-e9d1711b850d req-e7491722-a8d0-4c8c-9ea6-689065e49551 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:05.862260 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-b50b4456-ca6e-42f8-b6bb-e9d1711b850d req-e7491722-a8d0-4c8c-9ea6-689065e49551 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:05.882669 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-b50b4456-ca6e-42f8-b6bb-e9d1711b850d req-e7491722-a8d0-4c8c-9ea6-689065e49551 service nova] Creating event network-vif-deleted:aa010647-2532-4b5c-ba09-88875560b47b for instance f4d04a54-3696-41b9-95d8-aa2624b21b17 on hv-cinder-81803 Dec 20 03:32:05.896557 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-be4f6a3f-cdca-40a7-8704-0a8c005f1a0b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:05.898351 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-be4f6a3f-cdca-40a7-8704-0a8c005f1a0b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:05.902795 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-b50b4456-ca6e-42f8-b6bb-e9d1711b850d req-e7491722-a8d0-4c8c-9ea6-689065e49551 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058143 Dec 20 03:32:05.906045 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 241/492] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:32:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:32:05.911064 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-be4f6a3f-cdca-40a7-8704-0a8c005f1a0b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:05.911527 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-be4f6a3f-cdca-40a7-8704-0a8c005f1a0b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:05.912352 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-be4f6a3f-cdca-40a7-8704-0a8c005f1a0b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:05.912854 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-be4f6a3f-cdca-40a7-8704-0a8c005f1a0b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:05.916666 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-04967099-1ed0-45ff-b43c-44f50be2b9c0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:05.929634 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-04967099-1ed0-45ff-b43c-44f50be2b9c0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:05.947379 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-04967099-1ed0-45ff-b43c-44f50be2b9c0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:05.947732 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-04967099-1ed0-45ff-b43c-44f50be2b9c0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:05.948772 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-04967099-1ed0-45ff-b43c-44f50be2b9c0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:05.949430 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-04967099-1ed0-45ff-b43c-44f50be2b9c0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:06.075658 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-be4f6a3f-cdca-40a7-8704-0a8c005f1a0b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:06.092066 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-be4f6a3f-cdca-40a7-8704-0a8c005f1a0b tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1472 microversion: 2.1 time: 0.196088 Dec 20 03:32:06.093278 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 252/493] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:05 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1472 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:06.109772 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ca9a6190-f515-4e0b-bcf2-188826c70804 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:06.110310 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ca9a6190-f515-4e0b-bcf2-188826c70804 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:06.122363 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ca9a6190-f515-4e0b-bcf2-188826c70804 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:06.130179 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ca9a6190-f515-4e0b-bcf2-188826c70804 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:06.133898 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ca9a6190-f515-4e0b-bcf2-188826c70804 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:06.134716 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ca9a6190-f515-4e0b-bcf2-188826c70804 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:06.421591 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.objects.instance [None req-ca9a6190-f515-4e0b-bcf2-188826c70804 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lazy-loading 'services' on Instance uuid 5ec437d6-633a-468c-aa6a-d4c81df62919 {{(pid=117011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:32:06.477386 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-04967099-1ed0-45ff-b43c-44f50be2b9c0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:06.488210 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-04967099-1ed0-45ff-b43c-44f50be2b9c0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1502 microversion: 2.1 time: 0.580804 Dec 20 03:32:06.488815 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 242/494] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:05 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1502 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:06.526982 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-045c2d5e-6231-4a8c-a360-a514f1299c3d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8af8f886-6499-49f1-af14-8e8c3d1f5243"}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:32:06.528447 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-045c2d5e-6231-4a8c-a360-a514f1299c3d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:06.539551 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-045c2d5e-6231-4a8c-a360-a514f1299c3d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:06.540005 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-045c2d5e-6231-4a8c-a360-a514f1299c3d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:06.540872 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-045c2d5e-6231-4a8c-a360-a514f1299c3d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:06.541361 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-045c2d5e-6231-4a8c-a360-a514f1299c3d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:06.618119 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-045c2d5e-6231-4a8c-a360-a514f1299c3d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] HTTP exception thrown: Cannot 'attach_volume' instance 4e5cfe95-9804-4406-a893-82b021de3826 while it is in vm_state rescued Dec 20 03:32:06.618657 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-045c2d5e-6231-4a8c-a360-a514f1299c3d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Returning 409 to user: Cannot 'attach_volume' instance 4e5cfe95-9804-4406-a893-82b021de3826 while it is in vm_state rescued {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:32:06.619831 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-045c2d5e-6231-4a8c-a360-a514f1299c3d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "POST /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.097980 Dec 20 03:32:06.623559 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 243/495] 10.222.0.53 () {60 vars in 1322 bytes} [Mon Dec 20 03:32:06 2021] POST /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/os-volume_attachments => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 20 03:32:06.634868 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ac1b7ab8-ba15-4fd9-be86-2aba3bf23981 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:32:06.638880 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ac1b7ab8-ba15-4fd9-be86-2aba3bf23981 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:06.653262 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ac1b7ab8-ba15-4fd9-be86-2aba3bf23981 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:06.654157 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ac1b7ab8-ba15-4fd9-be86-2aba3bf23981 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:06.656221 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ac1b7ab8-ba15-4fd9-be86-2aba3bf23981 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:06.657261 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ac1b7ab8-ba15-4fd9-be86-2aba3bf23981 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:06.782417 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ca9a6190-f515-4e0b-bcf2-188826c70804 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "DELETE /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/os-volume_attachments/50f40728-5a94-465f-8d9d-08ef0b989452" status: 202 len: 0 microversion: 2.1 time: 0.686629 Dec 20 03:32:06.790869 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 253/496] 10.222.0.53 () {58 vars in 1415 bytes} [Mon Dec 20 03:32:06 2021] DELETE /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/os-volume_attachments/50f40728-5a94-465f-8d9d-08ef0b989452 => generated 0 bytes in 696 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:32:06.906300 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ac1b7ab8-ba15-4fd9-be86-2aba3bf23981 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "POST /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/action" status: 202 len: 0 microversion: 2.1 time: 0.275631 Dec 20 03:32:06.909828 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 244/497] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:32:06 2021] POST /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:32:06.926741 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-8fd44986-a248-4789-bd69-4de402842859 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:06.929969 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-8fd44986-a248-4789-bd69-4de402842859 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:06.945106 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8fd44986-a248-4789-bd69-4de402842859 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:06.946604 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8fd44986-a248-4789-bd69-4de402842859 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:06.948350 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8fd44986-a248-4789-bd69-4de402842859 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:06.949519 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8fd44986-a248-4789-bd69-4de402842859 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:07.126200 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-8887f044-c77f-45dd-b428-a20ebbbfdc47 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:07.130937 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-8887f044-c77f-45dd-b428-a20ebbbfdc47 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:07.142971 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8887f044-c77f-45dd-b428-a20ebbbfdc47 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:07.145782 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8887f044-c77f-45dd-b428-a20ebbbfdc47 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:07.149625 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8887f044-c77f-45dd-b428-a20ebbbfdc47 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:07.153249 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8887f044-c77f-45dd-b428-a20ebbbfdc47 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:07.251309 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8887f044-c77f-45dd-b428-a20ebbbfdc47 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:07.255515 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8887f044-c77f-45dd-b428-a20ebbbfdc47 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:07.256007 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.objects.instance [None req-8887f044-c77f-45dd-b428-a20ebbbfdc47 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lazy-loading 'fault' on Instance uuid f4d04a54-3696-41b9-95d8-aa2624b21b17 {{(pid=117012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:32:07.376591 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-8887f044-c77f-45dd-b428-a20ebbbfdc47 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9dcbac34c544fdea6152f710ab3d521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032e3b59ca34420bbb5bdcaaa1cbb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:07.390570 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-8887f044-c77f-45dd-b428-a20ebbbfdc47 tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 200 len: 1308 microversion: 2.1 time: 0.270431 Dec 20 03:32:07.395901 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 245/498] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:07 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 1308 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:07.608151 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-8fd44986-a248-4789-bd69-4de402842859 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:07.625567 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-8fd44986-a248-4789-bd69-4de402842859 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1510 microversion: 2.1 time: 0.708633 Dec 20 03:32:07.626458 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 254/499] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:06 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1510 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:08.423364 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-69511842-2a39-418f-b06d-257b0f58bd5e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:08.429862 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-69511842-2a39-418f-b06d-257b0f58bd5e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] [instance: f4d04a54-3696-41b9-95d8-aa2624b21b17] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:08.448068 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-69511842-2a39-418f-b06d-257b0f58bd5e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:08.450825 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-69511842-2a39-418f-b06d-257b0f58bd5e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:08.453671 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-69511842-2a39-418f-b06d-257b0f58bd5e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:08.455028 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-69511842-2a39-418f-b06d-257b0f58bd5e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:08.495966 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-69511842-2a39-418f-b06d-257b0f58bd5e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] HTTP exception thrown: Instance f4d04a54-3696-41b9-95d8-aa2624b21b17 could not be found. Dec 20 03:32:08.499743 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-69511842-2a39-418f-b06d-257b0f58bd5e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] Returning 404 to user: Instance f4d04a54-3696-41b9-95d8-aa2624b21b17 could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:32:08.501803 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-69511842-2a39-418f-b06d-257b0f58bd5e tempest-AttachVolumeNegativeTest-1792894987 tempest-AttachVolumeNegativeTest-1792894987-project] 10.222.0.53 "GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17" status: 404 len: 111 microversion: 2.1 time: 0.091097 Dec 20 03:32:08.503782 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 246/500] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:08 2021] GET /compute/v2.1/servers/f4d04a54-3696-41b9-95d8-aa2624b21b17 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:32:08.673508 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-6c5e10a5-498b-44a3-8b7b-387ad41104b9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:08.679691 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6c5e10a5-498b-44a3-8b7b-387ad41104b9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:08.696079 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6c5e10a5-498b-44a3-8b7b-387ad41104b9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:08.697347 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6c5e10a5-498b-44a3-8b7b-387ad41104b9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:08.701879 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6c5e10a5-498b-44a3-8b7b-387ad41104b9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:08.703102 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6c5e10a5-498b-44a3-8b7b-387ad41104b9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:09.239057 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e2050ec4-b424-4f95-814a-a05ffff350da tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:32:09.251403 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e2050ec4-b424-4f95-814a-a05ffff350da tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:09.252706 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e2050ec4-b424-4f95-814a-a05ffff350da tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:09.293595 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e2050ec4-b424-4f95-814a-a05ffff350da tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Going to try to stop instance {{(pid=117012) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 20 03:32:09.581469 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6c5e10a5-498b-44a3-8b7b-387ad41104b9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:09.592012 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-6c5e10a5-498b-44a3-8b7b-387ad41104b9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1510 microversion: 2.1 time: 0.946729 Dec 20 03:32:09.596334 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 255/501] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:08 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1510 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:09.674559 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e2050ec4-b424-4f95-814a-a05ffff350da tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 202 len: 0 microversion: 2.1 time: 0.439625 Dec 20 03:32:09.675914 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 247/502] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:32:09 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 20 03:32:09.717628 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1c15cc54-4b6c-40ea-88c5-6a36d13e01ae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:09.719176 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1c15cc54-4b6c-40ea-88c5-6a36d13e01ae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:09.774969 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1c15cc54-4b6c-40ea-88c5-6a36d13e01ae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:09.775418 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1c15cc54-4b6c-40ea-88c5-6a36d13e01ae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:09.780779 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1c15cc54-4b6c-40ea-88c5-6a36d13e01ae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:09.789192 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1c15cc54-4b6c-40ea-88c5-6a36d13e01ae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:10.508029 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-1c15cc54-4b6c-40ea-88c5-6a36d13e01ae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:10.520692 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1c15cc54-4b6c-40ea-88c5-6a36d13e01ae tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1678 microversion: 2.1 time: 0.839409 Dec 20 03:32:10.522655 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 256/503] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:09 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1678 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:10.620104 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a1935536-29ac-4ff5-8a2c-5c82a3a20e65 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:10.622136 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a1935536-29ac-4ff5-8a2c-5c82a3a20e65 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:10.643189 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a1935536-29ac-4ff5-8a2c-5c82a3a20e65 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:10.644503 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a1935536-29ac-4ff5-8a2c-5c82a3a20e65 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:10.648379 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a1935536-29ac-4ff5-8a2c-5c82a3a20e65 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:10.649129 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a1935536-29ac-4ff5-8a2c-5c82a3a20e65 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:11.245489 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-a1935536-29ac-4ff5-8a2c-5c82a3a20e65 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:11.255981 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a1935536-29ac-4ff5-8a2c-5c82a3a20e65 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1510 microversion: 2.1 time: 0.644525 Dec 20 03:32:11.257611 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 248/504] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:10 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1510 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:11.551615 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-6061bee2-be77-4c38-bbaf-62980944536d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:11.553932 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6061bee2-be77-4c38-bbaf-62980944536d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:11.582173 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6061bee2-be77-4c38-bbaf-62980944536d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:11.582616 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6061bee2-be77-4c38-bbaf-62980944536d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:11.583531 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6061bee2-be77-4c38-bbaf-62980944536d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:11.583988 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6061bee2-be77-4c38-bbaf-62980944536d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:12.293589 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c01d6ac4-24b1-425b-ac02-a7deefdee55a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:12.293589 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c01d6ac4-24b1-425b-ac02-a7deefdee55a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:12.306009 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c01d6ac4-24b1-425b-ac02-a7deefdee55a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:12.312394 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c01d6ac4-24b1-425b-ac02-a7deefdee55a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:12.313507 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c01d6ac4-24b1-425b-ac02-a7deefdee55a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:12.313969 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c01d6ac4-24b1-425b-ac02-a7deefdee55a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:12.525848 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6061bee2-be77-4c38-bbaf-62980944536d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:12.534414 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-6061bee2-be77-4c38-bbaf-62980944536d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1678 microversion: 2.1 time: 0.986852 Dec 20 03:32:12.535010 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 257/505] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:11 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1678 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:12.718854 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c01d6ac4-24b1-425b-ac02-a7deefdee55a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:12.728000 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c01d6ac4-24b1-425b-ac02-a7deefdee55a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1516 microversion: 2.1 time: 0.456849 Dec 20 03:32:12.732752 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 249/506] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:12 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1516 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:13.173891 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-88c70269-320d-469f-8226-b143e85b311f tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fe4edd2-cf19-41fb-9855-7c26a9553bf7", "device": "/dev/sdb"}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:32:13.175582 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-88c70269-320d-469f-8226-b143e85b311f tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:13.183200 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-88c70269-320d-469f-8226-b143e85b311f tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:13.183812 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-88c70269-320d-469f-8226-b143e85b311f tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:13.184734 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-88c70269-320d-469f-8226-b143e85b311f tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:13.185315 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-88c70269-320d-469f-8226-b143e85b311f tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:13.563765 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-0ba9783e-a958-4a23-9101-e4362793decd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:13.565388 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-0ba9783e-a958-4a23-9101-e4362793decd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:13.577548 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0ba9783e-a958-4a23-9101-e4362793decd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:13.578019 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0ba9783e-a958-4a23-9101-e4362793decd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:13.578865 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0ba9783e-a958-4a23-9101-e4362793decd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:13.579321 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0ba9783e-a958-4a23-9101-e4362793decd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:13.946027 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0ba9783e-a958-4a23-9101-e4362793decd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:13.954386 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-0ba9783e-a958-4a23-9101-e4362793decd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1678 microversion: 2.1 time: 0.394513 Dec 20 03:32:13.954979 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 250/507] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:13 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1678 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:14.473000 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-88c70269-320d-469f-8226-b143e85b311f tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "POST /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.302301 Dec 20 03:32:14.480140 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 258/508] 10.222.0.53 () {60 vars in 1322 bytes} [Mon Dec 20 03:32:13 2021] POST /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9/os-volume_attachments => generated 194 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:32:14.763308 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-52ea98cc-979d-4871-b2b9-3b69f67490f7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:14.764328 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-52ea98cc-979d-4871-b2b9-3b69f67490f7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:14.788747 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-52ea98cc-979d-4871-b2b9-3b69f67490f7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:14.789322 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-52ea98cc-979d-4871-b2b9-3b69f67490f7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:14.790158 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-52ea98cc-979d-4871-b2b9-3b69f67490f7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:14.802349 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-52ea98cc-979d-4871-b2b9-3b69f67490f7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:14.983922 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-027f99ad-76df-46b4-9239-d02d58901336 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:14.994018 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-027f99ad-76df-46b4-9239-d02d58901336 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:15.015233 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-027f99ad-76df-46b4-9239-d02d58901336 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:15.016747 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-027f99ad-76df-46b4-9239-d02d58901336 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:15.020265 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-027f99ad-76df-46b4-9239-d02d58901336 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:15.020265 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-027f99ad-76df-46b4-9239-d02d58901336 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:15.278060 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-52ea98cc-979d-4871-b2b9-3b69f67490f7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:15.295353 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-52ea98cc-979d-4871-b2b9-3b69f67490f7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1516 microversion: 2.1 time: 0.535700 Dec 20 03:32:15.297468 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 251/509] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:14 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1516 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:15.328328 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-35f24180-d32c-4ce5-8aeb-88dc80465bf8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed75bdfd-6e66-49c4-8d0f-5498af8af63a"}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:32:15.331896 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-35f24180-d32c-4ce5-8aeb-88dc80465bf8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:15.341951 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-027f99ad-76df-46b4-9239-d02d58901336 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:15.348426 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-35f24180-d32c-4ce5-8aeb-88dc80465bf8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:15.349601 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-35f24180-d32c-4ce5-8aeb-88dc80465bf8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:15.352249 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-35f24180-d32c-4ce5-8aeb-88dc80465bf8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:15.353763 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-35f24180-d32c-4ce5-8aeb-88dc80465bf8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:15.354876 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-027f99ad-76df-46b4-9239-d02d58901336 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1678 microversion: 2.1 time: 0.386136 Dec 20 03:32:15.356017 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 259/510] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:14 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1678 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:16.382508 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-752dff7e-b552-4aeb-adb4-b2b694bd4b7a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:16.382508 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-752dff7e-b552-4aeb-adb4-b2b694bd4b7a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:16.403249 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-752dff7e-b552-4aeb-adb4-b2b694bd4b7a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:16.403702 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-752dff7e-b552-4aeb-adb4-b2b694bd4b7a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:16.404592 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-752dff7e-b552-4aeb-adb4-b2b694bd4b7a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:16.405049 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-752dff7e-b552-4aeb-adb4-b2b694bd4b7a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:16.594403 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-35f24180-d32c-4ce5-8aeb-88dc80465bf8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "POST /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.270952 Dec 20 03:32:16.605956 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 252/511] 10.222.0.53 () {60 vars in 1322 bytes} [Mon Dec 20 03:32:15 2021] POST /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/os-volume_attachments => generated 194 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:32:17.017062 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-752dff7e-b552-4aeb-adb4-b2b694bd4b7a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:17.028343 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-752dff7e-b552-4aeb-adb4-b2b694bd4b7a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1678 microversion: 2.1 time: 0.650735 Dec 20 03:32:17.029343 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 260/512] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:16 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1678 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:18.056487 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-55245448-51ea-4083-a788-e29ba7aac9c8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:18.057217 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-55245448-51ea-4083-a788-e29ba7aac9c8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:18.075258 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-55245448-51ea-4083-a788-e29ba7aac9c8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:18.075776 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-55245448-51ea-4083-a788-e29ba7aac9c8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:18.079107 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-55245448-51ea-4083-a788-e29ba7aac9c8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:18.080213 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-55245448-51ea-4083-a788-e29ba7aac9c8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:18.151052 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-04da0b8c-385d-465f-89cd-5663784ffe3f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Action: 'create', calling method: .version_select at 0x7f49041fe700>, body: {"keypair": {"name": "tempest-TestShelveInstance-2050041413"}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:32:18.185468 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-04da0b8c-385d-465f-89cd-5663784ffe3f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Getting quotas for project e7560abef8ef4bc796f5d8caa41351d3. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:32:18.198325 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-04da0b8c-385d-465f-89cd-5663784ffe3f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Getting quotas for user 646502be90cb4564a1949d26f4922692 and project e7560abef8ef4bc796f5d8caa41351d3. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:32:18.441043 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-55245448-51ea-4083-a788-e29ba7aac9c8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:18.450443 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-55245448-51ea-4083-a788-e29ba7aac9c8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1678 microversion: 2.1 time: 0.398626 Dec 20 03:32:18.463642 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 261/513] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:18 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1678 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:18.937804 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-04da0b8c-385d-465f-89cd-5663784ffe3f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Getting quotas for project e7560abef8ef4bc796f5d8caa41351d3. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:32:18.963694 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-04da0b8c-385d-465f-89cd-5663784ffe3f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Getting quotas for user 646502be90cb4564a1949d26f4922692 and project e7560abef8ef4bc796f5d8caa41351d3. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:32:19.011298 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-04da0b8c-385d-465f-89cd-5663784ffe3f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 1.462997 Dec 20 03:32:19.021633 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 253/514] 10.222.0.53 () {60 vars in 1157 bytes} [Mon Dec 20 03:32:17 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:19.471681 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-4ddb13db-3847-4f35-bd0f-af7acb55cc4b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:19.473777 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-4ddb13db-3847-4f35-bd0f-af7acb55cc4b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:19.488807 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4ddb13db-3847-4f35-bd0f-af7acb55cc4b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:19.489669 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4ddb13db-3847-4f35-bd0f-af7acb55cc4b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:19.491336 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4ddb13db-3847-4f35-bd0f-af7acb55cc4b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:19.492181 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4ddb13db-3847-4f35-bd0f-af7acb55cc4b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:19.831090 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-4ddb13db-3847-4f35-bd0f-af7acb55cc4b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:19.844565 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-4ddb13db-3847-4f35-bd0f-af7acb55cc4b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1678 microversion: 2.1 time: 0.377415 Dec 20 03:32:19.853768 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 262/515] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:19 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1678 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:20.869178 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-768fd61d-0f72-43bf-bc6d-9a6c1c9738bd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:20.871567 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-768fd61d-0f72-43bf-bc6d-9a6c1c9738bd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:20.903526 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-768fd61d-0f72-43bf-bc6d-9a6c1c9738bd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:20.926114 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-768fd61d-0f72-43bf-bc6d-9a6c1c9738bd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:20.930738 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-768fd61d-0f72-43bf-bc6d-9a6c1c9738bd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:20.935108 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-768fd61d-0f72-43bf-bc6d-9a6c1c9738bd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:21.273636 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-768fd61d-0f72-43bf-bc6d-9a6c1c9738bd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:21.290650 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-768fd61d-0f72-43bf-bc6d-9a6c1c9738bd tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1655 microversion: 2.1 time: 0.431075 Dec 20 03:32:21.291838 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 254/516] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:20 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1655 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:21.312910 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-76bc7877-8c37-4813-b103-b948f3baf03f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:32:21.333639 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-76bc7877-8c37-4813-b103-b948f3baf03f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:21.334431 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-76bc7877-8c37-4813-b103-b948f3baf03f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:21.363841 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-76bc7877-8c37-4813-b103-b948f3baf03f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Going to try to start instance {{(pid=117011) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 20 03:32:21.603630 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-76bc7877-8c37-4813-b103-b948f3baf03f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action" status: 202 len: 0 microversion: 2.1 time: 0.298621 Dec 20 03:32:21.626591 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-9a295440-3ec8-4d70-a8f5-0a7839cb1e84 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:21.628141 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 263/517] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:32:21 2021] POST /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:32:21.628706 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-9a295440-3ec8-4d70-a8f5-0a7839cb1e84 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:21.644659 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9a295440-3ec8-4d70-a8f5-0a7839cb1e84 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:21.644659 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9a295440-3ec8-4d70-a8f5-0a7839cb1e84 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:21.645354 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9a295440-3ec8-4d70-a8f5-0a7839cb1e84 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:21.645799 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9a295440-3ec8-4d70-a8f5-0a7839cb1e84 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:22.341318 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-9a295440-3ec8-4d70-a8f5-0a7839cb1e84 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:22.348860 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-9a295440-3ec8-4d70-a8f5-0a7839cb1e84 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1664 microversion: 2.1 time: 0.731673 Dec 20 03:32:22.362741 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 255/518] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:21 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1664 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:23.371397 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0ebdef8c-3285-4fd9-84dc-84e9beb8f463 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:23.372177 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-0ebdef8c-3285-4fd9-84dc-84e9beb8f463 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:23.388415 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0ebdef8c-3285-4fd9-84dc-84e9beb8f463 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:23.395456 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0ebdef8c-3285-4fd9-84dc-84e9beb8f463 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:23.395456 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0ebdef8c-3285-4fd9-84dc-84e9beb8f463 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:23.395456 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0ebdef8c-3285-4fd9-84dc-84e9beb8f463 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:23.821769 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-0ebdef8c-3285-4fd9-84dc-84e9beb8f463 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:23.830388 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-0ebdef8c-3285-4fd9-84dc-84e9beb8f463 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1664 microversion: 2.1 time: 0.465652 Dec 20 03:32:23.831264 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 264/519] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:23 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1664 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:24.858689 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-4af22f47-37fc-42f5-ad69-2c2ec740f1f1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:24.860048 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-4af22f47-37fc-42f5-ad69-2c2ec740f1f1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:24.903483 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4af22f47-37fc-42f5-ad69-2c2ec740f1f1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:24.904233 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4af22f47-37fc-42f5-ad69-2c2ec740f1f1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:24.905266 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4af22f47-37fc-42f5-ad69-2c2ec740f1f1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:24.906653 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4af22f47-37fc-42f5-ad69-2c2ec740f1f1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:25.214225 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-4af22f47-37fc-42f5-ad69-2c2ec740f1f1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:25.247930 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-4af22f47-37fc-42f5-ad69-2c2ec740f1f1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1668 microversion: 2.1 time: 0.400790 Dec 20 03:32:25.255278 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 256/520] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:24 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1668 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:31.696021 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-9e39c136-8245-46fb-a5e6-324d95a1614c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:32:31.697278 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-9e39c136-8245-46fb-a5e6-324d95a1614c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:31.704778 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9e39c136-8245-46fb-a5e6-324d95a1614c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:31.705537 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9e39c136-8245-46fb-a5e6-324d95a1614c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:31.706542 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9e39c136-8245-46fb-a5e6-324d95a1614c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:31.707141 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9e39c136-8245-46fb-a5e6-324d95a1614c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:31.745603 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.objects.instance [None req-9e39c136-8245-46fb-a5e6-324d95a1614c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lazy-loading 'flavor' on Instance uuid 4e5cfe95-9804-4406-a893-82b021de3826 {{(pid=117011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:32:32.269495 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-9e39c136-8245-46fb-a5e6-324d95a1614c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "POST /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/action" status: 200 len: 32 microversion: 2.1 time: 0.577909 Dec 20 03:32:32.275924 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 265/521] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:32:31 2021] POST /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/action => generated 32 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 20 03:32:32.288057 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-cfb89c50-e896-4932-9e15-16706924e3fa tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:32.288937 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-cfb89c50-e896-4932-9e15-16706924e3fa tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:32.312960 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cfb89c50-e896-4932-9e15-16706924e3fa tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:32.317739 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cfb89c50-e896-4932-9e15-16706924e3fa tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:32.324166 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cfb89c50-e896-4932-9e15-16706924e3fa tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:32.324166 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cfb89c50-e896-4932-9e15-16706924e3fa tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:32.533060 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-cfb89c50-e896-4932-9e15-16706924e3fa tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:32.548338 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-cfb89c50-e896-4932-9e15-16706924e3fa tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.266006 Dec 20 03:32:32.549428 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 257/522] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:32 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:33.582918 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-72f3f5b1-fa9e-41ac-b187-6d7a0da84904 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:33.584130 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-72f3f5b1-fa9e-41ac-b187-6d7a0da84904 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:33.594427 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-72f3f5b1-fa9e-41ac-b187-6d7a0da84904 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:33.595158 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-72f3f5b1-fa9e-41ac-b187-6d7a0da84904 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:33.596166 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-72f3f5b1-fa9e-41ac-b187-6d7a0da84904 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:33.596769 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-72f3f5b1-fa9e-41ac-b187-6d7a0da84904 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:33.806622 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-72f3f5b1-fa9e-41ac-b187-6d7a0da84904 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:33.818697 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-72f3f5b1-fa9e-41ac-b187-6d7a0da84904 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.245708 Dec 20 03:32:33.819690 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 266/523] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:33 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:34.847683 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-cbd68235-1530-4e6d-a7c8-6f4edf5f40b4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:34.861055 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-cbd68235-1530-4e6d-a7c8-6f4edf5f40b4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:34.917280 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cbd68235-1530-4e6d-a7c8-6f4edf5f40b4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:34.921907 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cbd68235-1530-4e6d-a7c8-6f4edf5f40b4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:34.925980 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cbd68235-1530-4e6d-a7c8-6f4edf5f40b4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:34.929518 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cbd68235-1530-4e6d-a7c8-6f4edf5f40b4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:35.161283 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-cbd68235-1530-4e6d-a7c8-6f4edf5f40b4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:35.179091 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-cbd68235-1530-4e6d-a7c8-6f4edf5f40b4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.346484 Dec 20 03:32:35.192555 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 258/524] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:34 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:36.196883 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0df18004-e727-48ee-a8ed-403af396ca62 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:36.197557 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-0df18004-e727-48ee-a8ed-403af396ca62 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:36.211821 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0df18004-e727-48ee-a8ed-403af396ca62 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:36.217656 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0df18004-e727-48ee-a8ed-403af396ca62 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:36.217656 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0df18004-e727-48ee-a8ed-403af396ca62 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:36.217656 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0df18004-e727-48ee-a8ed-403af396ca62 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:36.407453 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-0df18004-e727-48ee-a8ed-403af396ca62 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:36.416916 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-0df18004-e727-48ee-a8ed-403af396ca62 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.224868 Dec 20 03:32:36.425431 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 267/525] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:36 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:37.435364 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-4896f31f-e48b-489c-ae80-dcd12326ef92 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:37.439209 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-4896f31f-e48b-489c-ae80-dcd12326ef92 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:37.444942 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4896f31f-e48b-489c-ae80-dcd12326ef92 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:37.445530 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4896f31f-e48b-489c-ae80-dcd12326ef92 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:37.446421 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4896f31f-e48b-489c-ae80-dcd12326ef92 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:37.446974 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4896f31f-e48b-489c-ae80-dcd12326ef92 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:37.629096 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-4896f31f-e48b-489c-ae80-dcd12326ef92 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:37.640519 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-4896f31f-e48b-489c-ae80-dcd12326ef92 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.209595 Dec 20 03:32:37.641495 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 259/526] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:37 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:38.661550 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f868be66-f928-4491-aaaa-d98d67515cd9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:38.663260 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-f868be66-f928-4491-aaaa-d98d67515cd9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:38.673245 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f868be66-f928-4491-aaaa-d98d67515cd9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:38.673994 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f868be66-f928-4491-aaaa-d98d67515cd9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:38.675016 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f868be66-f928-4491-aaaa-d98d67515cd9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:38.675635 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f868be66-f928-4491-aaaa-d98d67515cd9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:38.863544 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-f868be66-f928-4491-aaaa-d98d67515cd9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:38.873619 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f868be66-f928-4491-aaaa-d98d67515cd9 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.217646 Dec 20 03:32:38.874301 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 268/527] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:38 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:39.727618 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-2d0e6dc0-9a9b-46a0-967a-3034f8b0f01c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Action: 'create', calling method: .version_select at 0x7f4904172430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-26851016"}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:32:39.753044 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-2d0e6dc0-9a9b-46a0-967a-3034f8b0f01c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Getting quotas for project 74667b9b73e542e5a65f354d431c3b7a. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:32:39.758126 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-2d0e6dc0-9a9b-46a0-967a-3034f8b0f01c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Getting quotas for user a2523da3baff41f18a9037d19d5ca886 and project 74667b9b73e542e5a65f354d431c3b7a. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:32:39.891265 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-7d555bd6-be09-414e-8838-ab982246e99c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:39.892075 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-7d555bd6-be09-414e-8838-ab982246e99c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:39.909021 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7d555bd6-be09-414e-8838-ab982246e99c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:39.910343 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7d555bd6-be09-414e-8838-ab982246e99c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:39.912259 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7d555bd6-be09-414e-8838-ab982246e99c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:39.913480 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7d555bd6-be09-414e-8838-ab982246e99c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:40.070865 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-7d555bd6-be09-414e-8838-ab982246e99c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:40.080267 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-7d555bd6-be09-414e-8838-ab982246e99c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.192653 Dec 20 03:32:40.081317 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 269/528] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:39 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:40.243667 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-2d0e6dc0-9a9b-46a0-967a-3034f8b0f01c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Getting quotas for project 74667b9b73e542e5a65f354d431c3b7a. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:32:40.248743 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-2d0e6dc0-9a9b-46a0-967a-3034f8b0f01c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Getting quotas for user a2523da3baff41f18a9037d19d5ca886 and project 74667b9b73e542e5a65f354d431c3b7a. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:32:40.265840 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-2d0e6dc0-9a9b-46a0-967a-3034f8b0f01c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.546459 Dec 20 03:32:40.266354 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 260/529] 10.222.0.53 () {60 vars in 1157 bytes} [Mon Dec 20 03:32:39 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:40.401593 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ee97be96-6e63-4b12-8827-350c041fc7b8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-628738645", "imageRef": "e338a399-56ce-41ef-b2d2-a81d9c67f19f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-26851016", "networks": [{"uuid": "d4251048-07a2-46b4-8abe-fc4d95cf3d22"}]}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:32:40.471225 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.network.neutron [None req-ee97be96-6e63-4b12-8827-350c041fc7b8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] validate_networks() for [('d4251048-07a2-46b4-8abe-fc4d95cf3d22', None, None, None, None, None)] {{(pid=117011) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:32:40.919301 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-ee97be96-6e63-4b12-8827-350c041fc7b8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Flavor limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:32:40.919985 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-ee97be96-6e63-4b12-8827-350c041fc7b8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Image limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:32:40.920223 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-ee97be96-6e63-4b12-8827-350c041fc7b8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Flavor pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:32:40.920565 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-ee97be96-6e63-4b12-8827-350c041fc7b8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Image pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:32:40.921194 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-ee97be96-6e63-4b12-8827-350c041fc7b8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:32:40.931316 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ee97be96-6e63-4b12-8827-350c041fc7b8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:40.931763 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ee97be96-6e63-4b12-8827-350c041fc7b8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:40.932562 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ee97be96-6e63-4b12-8827-350c041fc7b8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:40.933071 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ee97be96-6e63-4b12-8827-350c041fc7b8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:40.960350 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-ee97be96-6e63-4b12-8827-350c041fc7b8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Getting quotas for project 74667b9b73e542e5a65f354d431c3b7a. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:32:40.966231 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-ee97be96-6e63-4b12-8827-350c041fc7b8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Getting quotas for user a2523da3baff41f18a9037d19d5ca886 and project 74667b9b73e542e5a65f354d431c3b7a. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:32:40.981603 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ee97be96-6e63-4b12-8827-350c041fc7b8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Going to run 1 instances... {{(pid=117011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:32:40.984180 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ee97be96-6e63-4b12-8827-350c041fc7b8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e338a399-56ce-41ef-b2d2-a81d9c67f19f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:32:41.102024 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-0a078569-a405-40fb-9743-31810c98f0e0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:41.111470 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-0a078569-a405-40fb-9743-31810c98f0e0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:41.111470 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0a078569-a405-40fb-9743-31810c98f0e0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:41.111470 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0a078569-a405-40fb-9743-31810c98f0e0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:41.111470 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0a078569-a405-40fb-9743-31810c98f0e0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:41.111938 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0a078569-a405-40fb-9743-31810c98f0e0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:41.160247 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ee97be96-6e63-4b12-8827-350c041fc7b8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765485 Dec 20 03:32:41.160890 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 270/530] 10.222.0.53 () {60 vars in 1146 bytes} [Mon Dec 20 03:32:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 03:32:41.172708 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1a51e621-974f-4ad1-8a9a-9adcaa62ee20 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:41.173662 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1a51e621-974f-4ad1-8a9a-9adcaa62ee20 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:41.251649 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-1a51e621-974f-4ad1-8a9a-9adcaa62ee20 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:41.259914 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1a51e621-974f-4ad1-8a9a-9adcaa62ee20 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1256 microversion: 2.1 time: 0.091830 Dec 20 03:32:41.269793 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 271/531] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:41 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1256 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:41.277252 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0a078569-a405-40fb-9743-31810c98f0e0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:41.288591 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-0a078569-a405-40fb-9743-31810c98f0e0 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.193336 Dec 20 03:32:41.289206 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 261/532] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:41 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:42.278660 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-3b567d38-3313-41c6-b127-0779168e0cf7 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:42.279358 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-3b567d38-3313-41c6-b127-0779168e0cf7 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:42.305606 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-755b66f0-4682-418e-bb15-5cfbf3a774dd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:42.306272 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-755b66f0-4682-418e-bb15-5cfbf3a774dd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:42.316362 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-755b66f0-4682-418e-bb15-5cfbf3a774dd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:42.316813 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-755b66f0-4682-418e-bb15-5cfbf3a774dd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:42.318195 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-755b66f0-4682-418e-bb15-5cfbf3a774dd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:42.318653 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-755b66f0-4682-418e-bb15-5cfbf3a774dd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:42.353506 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-3b567d38-3313-41c6-b127-0779168e0cf7 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:42.367259 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-3b567d38-3313-41c6-b127-0779168e0cf7 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1256 microversion: 2.1 time: 0.092726 Dec 20 03:32:42.368417 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 272/533] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:42 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1256 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:42.520022 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-755b66f0-4682-418e-bb15-5cfbf3a774dd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:42.531726 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-755b66f0-4682-418e-bb15-5cfbf3a774dd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.230178 Dec 20 03:32:42.532479 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 262/534] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:42 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:43.396614 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1adc1da5-ab5b-474a-96cb-ceacec4255dc tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:43.396614 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1adc1da5-ab5b-474a-96cb-ceacec4255dc tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:43.404500 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1adc1da5-ab5b-474a-96cb-ceacec4255dc tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:43.405337 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1adc1da5-ab5b-474a-96cb-ceacec4255dc tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:43.406834 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1adc1da5-ab5b-474a-96cb-ceacec4255dc tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:43.407608 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1adc1da5-ab5b-474a-96cb-ceacec4255dc tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:43.506966 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-1adc1da5-ab5b-474a-96cb-ceacec4255dc tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:43.516604 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1adc1da5-ab5b-474a-96cb-ceacec4255dc tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1308 microversion: 2.1 time: 0.125127 Dec 20 03:32:43.517560 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 273/535] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:43 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1308 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:43.550846 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-dc1a687c-0105-4da1-a582-15ce747dde2f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:43.555073 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-dc1a687c-0105-4da1-a582-15ce747dde2f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:43.559217 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dc1a687c-0105-4da1-a582-15ce747dde2f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:43.559745 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dc1a687c-0105-4da1-a582-15ce747dde2f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:43.560691 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dc1a687c-0105-4da1-a582-15ce747dde2f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:43.561221 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dc1a687c-0105-4da1-a582-15ce747dde2f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:43.705361 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-dc1a687c-0105-4da1-a582-15ce747dde2f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:43.720391 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-dc1a687c-0105-4da1-a582-15ce747dde2f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.166565 Dec 20 03:32:43.720391 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 263/536] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:43 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:44.535762 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d6d6ea44-8854-4e55-afaf-4c324864d52f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:44.537354 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d6d6ea44-8854-4e55-afaf-4c324864d52f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:44.546644 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d6d6ea44-8854-4e55-afaf-4c324864d52f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:44.547100 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d6d6ea44-8854-4e55-afaf-4c324864d52f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:44.547947 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d6d6ea44-8854-4e55-afaf-4c324864d52f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:44.548696 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d6d6ea44-8854-4e55-afaf-4c324864d52f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:44.624953 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d6d6ea44-8854-4e55-afaf-4c324864d52f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:44.636350 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d6d6ea44-8854-4e55-afaf-4c324864d52f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1326 microversion: 2.1 time: 0.104789 Dec 20 03:32:44.647930 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 274/537] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:44 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1326 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:44.735897 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-567fee46-0d67-4747-b4b6-7dee8b91eaf7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:44.736485 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-567fee46-0d67-4747-b4b6-7dee8b91eaf7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:44.743657 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-567fee46-0d67-4747-b4b6-7dee8b91eaf7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:44.744205 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-567fee46-0d67-4747-b4b6-7dee8b91eaf7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:44.744977 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-567fee46-0d67-4747-b4b6-7dee8b91eaf7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:44.745479 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-567fee46-0d67-4747-b4b6-7dee8b91eaf7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:44.925539 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-567fee46-0d67-4747-b4b6-7dee8b91eaf7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:44.944033 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-567fee46-0d67-4747-b4b6-7dee8b91eaf7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.211028 Dec 20 03:32:44.945284 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 264/538] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:44 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:45.058359 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b69a8938-75cc-4c43-8a04-26777cb56841 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:45.059473 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-b69a8938-75cc-4c43-8a04-26777cb56841 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:45.070371 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b69a8938-75cc-4c43-8a04-26777cb56841 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:45.071159 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b69a8938-75cc-4c43-8a04-26777cb56841 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:45.072632 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b69a8938-75cc-4c43-8a04-26777cb56841 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:45.074415 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b69a8938-75cc-4c43-8a04-26777cb56841 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:45.191770 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.objects.instance [None req-b69a8938-75cc-4c43-8a04-26777cb56841 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lazy-loading 'services' on Instance uuid bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 {{(pid=117011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:32:45.659780 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c6879bce-a8bc-4e4b-8945-e7975813fd18 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:45.668690 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c6879bce-a8bc-4e4b-8945-e7975813fd18 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:45.672080 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c6879bce-a8bc-4e4b-8945-e7975813fd18 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:45.672839 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c6879bce-a8bc-4e4b-8945-e7975813fd18 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:45.674199 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c6879bce-a8bc-4e4b-8945-e7975813fd18 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:45.675017 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c6879bce-a8bc-4e4b-8945-e7975813fd18 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:45.712351 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b69a8938-75cc-4c43-8a04-26777cb56841 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "DELETE /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9/os-volume_attachments/7fe4edd2-cf19-41fb-9855-7c26a9553bf7" status: 202 len: 0 microversion: 2.1 time: 0.657939 Dec 20 03:32:45.715247 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 275/539] 10.222.0.53 () {58 vars in 1415 bytes} [Mon Dec 20 03:32:45 2021] DELETE /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9/os-volume_attachments/7fe4edd2-cf19-41fb-9855-7c26a9553bf7 => generated 0 bytes in 662 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:32:45.968122 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-9cd3876d-833c-45b8-b193-73052350ad29 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:45.969009 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-9cd3876d-833c-45b8-b193-73052350ad29 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:45.983329 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9cd3876d-833c-45b8-b193-73052350ad29 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:45.984091 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9cd3876d-833c-45b8-b193-73052350ad29 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:45.985129 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9cd3876d-833c-45b8-b193-73052350ad29 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:45.988907 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9cd3876d-833c-45b8-b193-73052350ad29 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:46.033969 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c6879bce-a8bc-4e4b-8945-e7975813fd18 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:46.048853 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c6879bce-a8bc-4e4b-8945-e7975813fd18 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1356 microversion: 2.1 time: 0.394976 Dec 20 03:32:46.050992 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 265/540] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:45 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1356 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:46.345808 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9cd3876d-833c-45b8-b193-73052350ad29 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:46.356378 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-9cd3876d-833c-45b8-b193-73052350ad29 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.392852 Dec 20 03:32:46.362410 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 276/541] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:45 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:47.070122 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-00b22f51-9be0-453b-a77e-dd944f690c61 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:47.070982 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-00b22f51-9be0-453b-a77e-dd944f690c61 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:47.078643 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-00b22f51-9be0-453b-a77e-dd944f690c61 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:47.079126 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-00b22f51-9be0-453b-a77e-dd944f690c61 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:47.079944 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-00b22f51-9be0-453b-a77e-dd944f690c61 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:47.080453 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-00b22f51-9be0-453b-a77e-dd944f690c61 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:47.275097 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-00b22f51-9be0-453b-a77e-dd944f690c61 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:47.283651 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-00b22f51-9be0-453b-a77e-dd944f690c61 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1356 microversion: 2.1 time: 0.218459 Dec 20 03:32:47.284208 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 266/542] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:47 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1356 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:47.385813 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-36376dc1-dbca-4911-9278-748cfb03fd18 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:47.387675 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-36376dc1-dbca-4911-9278-748cfb03fd18 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:47.396347 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-36376dc1-dbca-4911-9278-748cfb03fd18 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:47.397283 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-36376dc1-dbca-4911-9278-748cfb03fd18 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:47.398526 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-36376dc1-dbca-4911-9278-748cfb03fd18 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:47.399078 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-36376dc1-dbca-4911-9278-748cfb03fd18 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:47.603772 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-36376dc1-dbca-4911-9278-748cfb03fd18 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:47.612664 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-36376dc1-dbca-4911-9278-748cfb03fd18 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.236022 Dec 20 03:32:47.613998 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 277/543] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:47 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:48.312778 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f77aaaaa-ecac-4be5-bc0c-b7a32615c912 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:48.313569 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f77aaaaa-ecac-4be5-bc0c-b7a32615c912 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:48.320697 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f77aaaaa-ecac-4be5-bc0c-b7a32615c912 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:48.321243 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f77aaaaa-ecac-4be5-bc0c-b7a32615c912 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:48.322065 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f77aaaaa-ecac-4be5-bc0c-b7a32615c912 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:48.322494 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f77aaaaa-ecac-4be5-bc0c-b7a32615c912 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:48.516778 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-f77aaaaa-ecac-4be5-bc0c-b7a32615c912 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:48.525867 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f77aaaaa-ecac-4be5-bc0c-b7a32615c912 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1356 microversion: 2.1 time: 0.217217 Dec 20 03:32:48.526509 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 267/544] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:48 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1356 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:48.643920 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ed9c7c8f-8b3d-47b7-b889-1dd450df6291 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:48.645900 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ed9c7c8f-8b3d-47b7-b889-1dd450df6291 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:48.660514 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ed9c7c8f-8b3d-47b7-b889-1dd450df6291 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:48.661017 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ed9c7c8f-8b3d-47b7-b889-1dd450df6291 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:48.661848 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ed9c7c8f-8b3d-47b7-b889-1dd450df6291 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:48.662287 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ed9c7c8f-8b3d-47b7-b889-1dd450df6291 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:48.867298 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ed9c7c8f-8b3d-47b7-b889-1dd450df6291 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:48.877758 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ed9c7c8f-8b3d-47b7-b889-1dd450df6291 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.238357 Dec 20 03:32:48.878878 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 278/545] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:48 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:49.545706 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-98529369-37e8-49fe-9115-47b177c9dd38 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:49.547223 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-98529369-37e8-49fe-9115-47b177c9dd38 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:49.554652 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-98529369-37e8-49fe-9115-47b177c9dd38 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:49.555113 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-98529369-37e8-49fe-9115-47b177c9dd38 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:49.557641 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-98529369-37e8-49fe-9115-47b177c9dd38 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:49.558325 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-98529369-37e8-49fe-9115-47b177c9dd38 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:49.768162 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-98529369-37e8-49fe-9115-47b177c9dd38 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:49.778411 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-98529369-37e8-49fe-9115-47b177c9dd38 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1356 microversion: 2.1 time: 0.236840 Dec 20 03:32:49.779496 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 268/546] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:49 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1356 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:49.949369 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-79f080cc-ab05-4d06-ba24-01bbc6ffe740 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:49.949369 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-79f080cc-ab05-4d06-ba24-01bbc6ffe740 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:49.949369 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-79f080cc-ab05-4d06-ba24-01bbc6ffe740 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:49.949369 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-79f080cc-ab05-4d06-ba24-01bbc6ffe740 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:49.950980 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-79f080cc-ab05-4d06-ba24-01bbc6ffe740 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:49.950980 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-79f080cc-ab05-4d06-ba24-01bbc6ffe740 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:50.117353 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a70d2966-3a5a-4aff-8d02-788c61564e9c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-137677517", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2050041413", "security_groups": [{"name": "tempest-secgroup-smoke-84746050"}], "networks": [{"uuid": "3a4f5256-0134-485c-b89e-07462238aa13"}], "block_device_mapping_v2": [{"uuid": "da31cc9b-f852-46d8-b6b5-387fe654721d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:32:50.122833 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-79f080cc-ab05-4d06-ba24-01bbc6ffe740 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:50.145884 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-79f080cc-ab05-4d06-ba24-01bbc6ffe740 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.251631 Dec 20 03:32:50.146927 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 279/547] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:49 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:50.315527 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.network.neutron [None req-a70d2966-3a5a-4aff-8d02-788c61564e9c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] validate_networks() for [('3a4f5256-0134-485c-b89e-07462238aa13', None, None, None, None, None)] {{(pid=117012) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:32:50.806701 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-7d4dd353-8fd9-462e-a3cf-43ebeae04f9f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:50.806701 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-7d4dd353-8fd9-462e-a3cf-43ebeae04f9f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:50.814062 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7d4dd353-8fd9-462e-a3cf-43ebeae04f9f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:50.814507 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7d4dd353-8fd9-462e-a3cf-43ebeae04f9f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:50.816582 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7d4dd353-8fd9-462e-a3cf-43ebeae04f9f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:50.817474 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7d4dd353-8fd9-462e-a3cf-43ebeae04f9f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:50.998859 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-7d4dd353-8fd9-462e-a3cf-43ebeae04f9f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:51.016464 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-7d4dd353-8fd9-462e-a3cf-43ebeae04f9f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1356 microversion: 2.1 time: 0.208011 Dec 20 03:32:51.016464 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 280/548] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:50 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1356 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:51.077116 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-a70d2966-3a5a-4aff-8d02-788c61564e9c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Flavor limits 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:32:51.085436 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-a70d2966-3a5a-4aff-8d02-788c61564e9c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Image limits 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:32:51.085436 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-a70d2966-3a5a-4aff-8d02-788c61564e9c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Flavor pref 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:32:51.085436 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-a70d2966-3a5a-4aff-8d02-788c61564e9c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Image pref 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:32:51.085436 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-a70d2966-3a5a-4aff-8d02-788c61564e9c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:32:51.100928 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a70d2966-3a5a-4aff-8d02-788c61564e9c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:51.102282 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a70d2966-3a5a-4aff-8d02-788c61564e9c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:51.104168 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a70d2966-3a5a-4aff-8d02-788c61564e9c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:51.105332 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a70d2966-3a5a-4aff-8d02-788c61564e9c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:51.132851 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-a70d2966-3a5a-4aff-8d02-788c61564e9c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Getting quotas for project e7560abef8ef4bc796f5d8caa41351d3. Resources: {'instances', 'ram', 'cores'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:32:51.137606 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-a70d2966-3a5a-4aff-8d02-788c61564e9c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Getting quotas for user 646502be90cb4564a1949d26f4922692 and project e7560abef8ef4bc796f5d8caa41351d3. Resources: {'instances', 'ram', 'cores'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:32:51.164579 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0e808f2d-8dad-40c2-9131-e43e0ac13fef tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:51.165366 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-0e808f2d-8dad-40c2-9131-e43e0ac13fef tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:51.172556 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0e808f2d-8dad-40c2-9131-e43e0ac13fef tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:51.173114 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0e808f2d-8dad-40c2-9131-e43e0ac13fef tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:51.173939 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0e808f2d-8dad-40c2-9131-e43e0ac13fef tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:51.174606 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0e808f2d-8dad-40c2-9131-e43e0ac13fef tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:51.251989 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a70d2966-3a5a-4aff-8d02-788c61564e9c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Going to run 1 instances... {{(pid=117012) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:32:51.257989 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a70d2966-3a5a-4aff-8d02-788c61564e9c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da31cc9b-f852-46d8-b6b5-387fe654721d',volume_size=None,volume_type=None)] {{(pid=117012) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:32:51.382181 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-0e808f2d-8dad-40c2-9131-e43e0ac13fef tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:51.391574 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-0e808f2d-8dad-40c2-9131-e43e0ac13fef tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.231775 Dec 20 03:32:51.392188 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 281/549] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:51 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:52.033703 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-25f79cc7-d2d0-4386-b835-5c8983e1ca10 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:52.035070 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-25f79cc7-d2d0-4386-b835-5c8983e1ca10 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:52.045729 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-25f79cc7-d2d0-4386-b835-5c8983e1ca10 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:52.046308 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-25f79cc7-d2d0-4386-b835-5c8983e1ca10 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:52.047192 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-25f79cc7-d2d0-4386-b835-5c8983e1ca10 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:52.047725 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-25f79cc7-d2d0-4386-b835-5c8983e1ca10 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:52.200280 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-25f79cc7-d2d0-4386-b835-5c8983e1ca10 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:52.212481 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-25f79cc7-d2d0-4386-b835-5c8983e1ca10 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1356 microversion: 2.1 time: 0.188755 Dec 20 03:32:52.213610 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 282/550] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:52 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1356 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:52.226193 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a70d2966-3a5a-4aff-8d02-788c61564e9c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.114084 Dec 20 03:32:52.234570 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 269/551] 10.222.0.53 () {60 vars in 1146 bytes} [Mon Dec 20 03:32:50 2021] POST /compute/v2.1/servers => generated 404 bytes in 2116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 20 03:32:52.244387 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-5d4974d6-c710-4a4a-bd3b-d6505489a026 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:52.245075 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-5d4974d6-c710-4a4a-bd3b-d6505489a026 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:52.328069 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-5d4974d6-c710-4a4a-bd3b-d6505489a026 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:52.341003 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-5d4974d6-c710-4a4a-bd3b-d6505489a026 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1088 microversion: 2.1 time: 0.100697 Dec 20 03:32:52.342307 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 283/552] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:52 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1088 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:52.412063 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-5b6c79ef-c74a-44fa-9ad0-4b6f9ef6dca7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:52.412978 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-5b6c79ef-c74a-44fa-9ad0-4b6f9ef6dca7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:52.421604 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5b6c79ef-c74a-44fa-9ad0-4b6f9ef6dca7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:52.422515 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5b6c79ef-c74a-44fa-9ad0-4b6f9ef6dca7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:52.424024 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5b6c79ef-c74a-44fa-9ad0-4b6f9ef6dca7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:52.424710 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5b6c79ef-c74a-44fa-9ad0-4b6f9ef6dca7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:52.583556 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-5b6c79ef-c74a-44fa-9ad0-4b6f9ef6dca7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:52.591987 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-5b6c79ef-c74a-44fa-9ad0-4b6f9ef6dca7 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.184831 Dec 20 03:32:52.593805 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 270/553] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:52 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:53.230057 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-930c601c-e2fc-4205-a2b4-aced4ca5aeed tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:53.230945 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-930c601c-e2fc-4205-a2b4-aced4ca5aeed tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:53.237496 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-930c601c-e2fc-4205-a2b4-aced4ca5aeed tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:53.237949 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-930c601c-e2fc-4205-a2b4-aced4ca5aeed tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:53.238998 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-930c601c-e2fc-4205-a2b4-aced4ca5aeed tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:53.240259 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-930c601c-e2fc-4205-a2b4-aced4ca5aeed tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:53.361408 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-0ce6a900-c671-44b3-9464-58dd9ff8db3c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:53.363168 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-0ce6a900-c671-44b3-9464-58dd9ff8db3c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:53.440620 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0ce6a900-c671-44b3-9464-58dd9ff8db3c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:53.464367 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-0ce6a900-c671-44b3-9464-58dd9ff8db3c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1088 microversion: 2.1 time: 0.107609 Dec 20 03:32:53.467390 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 271/554] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:53 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1088 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:53.611045 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-6d74d0e7-96c5-4a7e-8877-b65d8dfe4678 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:53.612150 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6d74d0e7-96c5-4a7e-8877-b65d8dfe4678 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:53.634237 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6d74d0e7-96c5-4a7e-8877-b65d8dfe4678 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:53.637948 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6d74d0e7-96c5-4a7e-8877-b65d8dfe4678 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:53.637948 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6d74d0e7-96c5-4a7e-8877-b65d8dfe4678 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:53.638809 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6d74d0e7-96c5-4a7e-8877-b65d8dfe4678 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:53.743121 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-930c601c-e2fc-4205-a2b4-aced4ca5aeed tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:53.753011 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-930c601c-e2fc-4205-a2b4-aced4ca5aeed tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1356 microversion: 2.1 time: 0.526598 Dec 20 03:32:53.753921 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 284/555] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:53 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1356 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:53.868392 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-6d74d0e7-96c5-4a7e-8877-b65d8dfe4678 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:53.876794 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-6d74d0e7-96c5-4a7e-8877-b65d8dfe4678 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.269604 Dec 20 03:32:53.877404 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 272/556] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:53 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:54.486251 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d9a788ef-5a47-4a55-9886-25e83e04fee0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:54.486251 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d9a788ef-5a47-4a55-9886-25e83e04fee0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:54.493495 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d9a788ef-5a47-4a55-9886-25e83e04fee0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:54.493964 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d9a788ef-5a47-4a55-9886-25e83e04fee0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:54.494748 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d9a788ef-5a47-4a55-9886-25e83e04fee0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:54.495186 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d9a788ef-5a47-4a55-9886-25e83e04fee0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:54.565115 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d9a788ef-5a47-4a55-9886-25e83e04fee0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:54.573736 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d9a788ef-5a47-4a55-9886-25e83e04fee0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1138 microversion: 2.1 time: 0.092799 Dec 20 03:32:54.574327 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 285/557] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:54 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1138 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:54.772254 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-4447f635-9631-45cd-b924-e5ed7194063e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:54.773666 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-4447f635-9631-45cd-b924-e5ed7194063e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:54.784317 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4447f635-9631-45cd-b924-e5ed7194063e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:54.784777 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4447f635-9631-45cd-b924-e5ed7194063e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:54.785615 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4447f635-9631-45cd-b924-e5ed7194063e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:54.786663 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4447f635-9631-45cd-b924-e5ed7194063e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:54.898539 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-8fdb3bc2-5ba2-4e9b-9340-b7d36d0aba15 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:54.900245 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-8fdb3bc2-5ba2-4e9b-9340-b7d36d0aba15 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:54.916268 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8fdb3bc2-5ba2-4e9b-9340-b7d36d0aba15 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:54.917579 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8fdb3bc2-5ba2-4e9b-9340-b7d36d0aba15 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:54.919037 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8fdb3bc2-5ba2-4e9b-9340-b7d36d0aba15 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:54.919681 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8fdb3bc2-5ba2-4e9b-9340-b7d36d0aba15 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:55.030934 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-4447f635-9631-45cd-b924-e5ed7194063e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:55.044592 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-4447f635-9631-45cd-b924-e5ed7194063e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1356 microversion: 2.1 time: 0.276017 Dec 20 03:32:55.045878 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 273/558] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:54 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1356 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:55.140025 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-8fdb3bc2-5ba2-4e9b-9340-b7d36d0aba15 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:55.151236 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-8fdb3bc2-5ba2-4e9b-9340-b7d36d0aba15 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.260951 Dec 20 03:32:55.152027 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 286/559] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:54 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:55.590530 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7df12186-f990-448f-8fd5-12204d9470a5 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:55.591266 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-7df12186-f990-448f-8fd5-12204d9470a5 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:55.601773 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7df12186-f990-448f-8fd5-12204d9470a5 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:55.602903 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7df12186-f990-448f-8fd5-12204d9470a5 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:55.609246 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7df12186-f990-448f-8fd5-12204d9470a5 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:55.609995 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7df12186-f990-448f-8fd5-12204d9470a5 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:55.704980 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7df12186-f990-448f-8fd5-12204d9470a5 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:55.715132 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7df12186-f990-448f-8fd5-12204d9470a5 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1138 microversion: 2.1 time: 0.128155 Dec 20 03:32:55.716630 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 274/560] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:55 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1138 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:56.075261 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b8c6cc80-90ab-4efd-9702-2e86f9684a3c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:56.076430 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-b8c6cc80-90ab-4efd-9702-2e86f9684a3c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:56.088508 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b8c6cc80-90ab-4efd-9702-2e86f9684a3c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:56.095157 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b8c6cc80-90ab-4efd-9702-2e86f9684a3c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:56.095157 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b8c6cc80-90ab-4efd-9702-2e86f9684a3c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:56.095157 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b8c6cc80-90ab-4efd-9702-2e86f9684a3c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:56.173158 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e82dfccd-70d4-4dde-9dfe-c72ff82a66fb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:56.175953 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e82dfccd-70d4-4dde-9dfe-c72ff82a66fb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:56.195320 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e82dfccd-70d4-4dde-9dfe-c72ff82a66fb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:56.195974 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e82dfccd-70d4-4dde-9dfe-c72ff82a66fb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:56.196826 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e82dfccd-70d4-4dde-9dfe-c72ff82a66fb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:56.197359 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e82dfccd-70d4-4dde-9dfe-c72ff82a66fb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:56.340211 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b8c6cc80-90ab-4efd-9702-2e86f9684a3c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:56.347796 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b8c6cc80-90ab-4efd-9702-2e86f9684a3c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1356 microversion: 2.1 time: 0.282505 Dec 20 03:32:56.348357 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 287/561] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:56 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1356 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:56.468917 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-e82dfccd-70d4-4dde-9dfe-c72ff82a66fb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:56.478915 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e82dfccd-70d4-4dde-9dfe-c72ff82a66fb tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.313574 Dec 20 03:32:56.479501 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 275/562] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:56 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:56.735502 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-c8225779-8033-4be5-8a76-7833027fe3fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:56.736606 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-c8225779-8033-4be5-8a76-7833027fe3fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:56.746977 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c8225779-8033-4be5-8a76-7833027fe3fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:56.747851 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c8225779-8033-4be5-8a76-7833027fe3fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:56.748741 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c8225779-8033-4be5-8a76-7833027fe3fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:56.749307 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c8225779-8033-4be5-8a76-7833027fe3fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:56.826211 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-c8225779-8033-4be5-8a76-7833027fe3fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:56.841097 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-c8225779-8033-4be5-8a76-7833027fe3fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1138 microversion: 2.1 time: 0.110424 Dec 20 03:32:56.842153 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 288/563] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:56 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1138 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:57.372891 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-3c5a1b5e-180c-4c12-803a-3b282d7c4cdf tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:57.377461 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-3c5a1b5e-180c-4c12-803a-3b282d7c4cdf tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:57.389365 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3c5a1b5e-180c-4c12-803a-3b282d7c4cdf tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:57.390954 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3c5a1b5e-180c-4c12-803a-3b282d7c4cdf tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:57.392470 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3c5a1b5e-180c-4c12-803a-3b282d7c4cdf tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:57.394295 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3c5a1b5e-180c-4c12-803a-3b282d7c4cdf tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:57.502031 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-facd98ac-47f2-4dce-a9f7-4555f0351252 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:57.502936 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-facd98ac-47f2-4dce-a9f7-4555f0351252 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:57.517919 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-facd98ac-47f2-4dce-a9f7-4555f0351252 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:57.519178 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-facd98ac-47f2-4dce-a9f7-4555f0351252 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:57.523175 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-facd98ac-47f2-4dce-a9f7-4555f0351252 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:57.523989 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-facd98ac-47f2-4dce-a9f7-4555f0351252 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:57.752379 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-facd98ac-47f2-4dce-a9f7-4555f0351252 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:57.769680 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-facd98ac-47f2-4dce-a9f7-4555f0351252 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.274932 Dec 20 03:32:57.789691 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 289/564] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:57 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:57.861080 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d27c4998-9723-4df1-89ba-d03232902706 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:57.861732 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d27c4998-9723-4df1-89ba-d03232902706 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:57.878111 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d27c4998-9723-4df1-89ba-d03232902706 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:57.878111 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d27c4998-9723-4df1-89ba-d03232902706 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:57.878111 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d27c4998-9723-4df1-89ba-d03232902706 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:57.878111 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d27c4998-9723-4df1-89ba-d03232902706 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:57.917771 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-3c5a1b5e-180c-4c12-803a-3b282d7c4cdf tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:57.934540 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-3c5a1b5e-180c-4c12-803a-3b282d7c4cdf tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1356 microversion: 2.1 time: 0.567760 Dec 20 03:32:57.939503 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 276/565] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:57 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1356 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:57.979876 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d27c4998-9723-4df1-89ba-d03232902706 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:57.997553 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d27c4998-9723-4df1-89ba-d03232902706 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1130 microversion: 2.1 time: 0.139874 Dec 20 03:32:57.998688 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 290/566] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:57 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1130 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:58.453121 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-8fd8b115-4332-474b-beba-23a59fcaa39a req-65a51a13-ab24-4725-830c-9e1ea0454967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2dfd907-6eb9-4420-b9dc-36fa0518d29a", "tag": "252e4b81-2b8b-4472-b0f9-0b2a9b974c88"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:32:58.462815 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:32:58.462815 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:32:58.487741 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-8fd8b115-4332-474b-beba-23a59fcaa39a req-65a51a13-ab24-4725-830c-9e1ea0454967 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:58.488339 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-8fd8b115-4332-474b-beba-23a59fcaa39a req-65a51a13-ab24-4725-830c-9e1ea0454967 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:58.501127 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-8fd8b115-4332-474b-beba-23a59fcaa39a req-65a51a13-ab24-4725-830c-9e1ea0454967 service nova] Creating event network-changed:252e4b81-2b8b-4472-b0f9-0b2a9b974c88 for instance d2dfd907-6eb9-4420-b9dc-36fa0518d29a on hv-cinder-81803 Dec 20 03:32:58.511727 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-8fd8b115-4332-474b-beba-23a59fcaa39a req-65a51a13-ab24-4725-830c-9e1ea0454967 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071532 Dec 20 03:32:58.512900 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 277/567] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:32:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:32:58.821033 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-89dc4fd1-fe7e-4abb-9d8d-2f7bf4319500 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:58.822818 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-89dc4fd1-fe7e-4abb-9d8d-2f7bf4319500 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:58.842034 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-89dc4fd1-fe7e-4abb-9d8d-2f7bf4319500 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:58.842699 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-89dc4fd1-fe7e-4abb-9d8d-2f7bf4319500 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:58.843939 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-89dc4fd1-fe7e-4abb-9d8d-2f7bf4319500 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:58.844786 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-89dc4fd1-fe7e-4abb-9d8d-2f7bf4319500 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:58.953371 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-835e2ab7-58c4-42da-b7ad-43f83caf3d0e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:58.954247 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-835e2ab7-58c4-42da-b7ad-43f83caf3d0e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:58.967352 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-835e2ab7-58c4-42da-b7ad-43f83caf3d0e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:58.968573 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-835e2ab7-58c4-42da-b7ad-43f83caf3d0e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:58.970090 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-835e2ab7-58c4-42da-b7ad-43f83caf3d0e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:58.971913 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-835e2ab7-58c4-42da-b7ad-43f83caf3d0e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:59.116501 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-89dc4fd1-fe7e-4abb-9d8d-2f7bf4319500 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:59.128095 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-89dc4fd1-fe7e-4abb-9d8d-2f7bf4319500 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.317050 Dec 20 03:32:59.129065 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 291/568] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:58 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:59.144359 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-17a322fc-e03e-4ee2-b57b-b46716f8d63b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:59.145189 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-17a322fc-e03e-4ee2-b57b-b46716f8d63b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:59.153798 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-17a322fc-e03e-4ee2-b57b-b46716f8d63b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:59.157467 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-17a322fc-e03e-4ee2-b57b-b46716f8d63b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:59.157467 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-17a322fc-e03e-4ee2-b57b-b46716f8d63b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:59.157467 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-17a322fc-e03e-4ee2-b57b-b46716f8d63b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:59.197391 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-17a322fc-e03e-4ee2-b57b-b46716f8d63b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Going to try to terminate instance {{(pid=117011) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:32:59.235321 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-835e2ab7-58c4-42da-b7ad-43f83caf3d0e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:59.246095 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-835e2ab7-58c4-42da-b7ad-43f83caf3d0e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1356 microversion: 2.1 time: 0.297248 Dec 20 03:32:59.246678 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 278/569] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:58 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1356 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:32:59.260432 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-73c2013a-afef-4fd4-a20e-5eb1be6aed81 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:59.260432 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-73c2013a-afef-4fd4-a20e-5eb1be6aed81 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:59.261432 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-73c2013a-afef-4fd4-a20e-5eb1be6aed81 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:59.261633 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-73c2013a-afef-4fd4-a20e-5eb1be6aed81 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:59.262464 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-73c2013a-afef-4fd4-a20e-5eb1be6aed81 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:59.262907 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-73c2013a-afef-4fd4-a20e-5eb1be6aed81 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:59.405364 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-73c2013a-afef-4fd4-a20e-5eb1be6aed81 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:59.416132 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-73c2013a-afef-4fd4-a20e-5eb1be6aed81 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1204 microversion: 2.1 time: 0.168142 Dec 20 03:32:59.417195 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 279/570] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:59 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1204 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:32:59.596044 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-17a322fc-e03e-4ee2-b57b-b46716f8d63b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "DELETE /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9" status: 204 len: 0 microversion: 2.1 time: 0.464969 Dec 20 03:32:59.596644 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 292/571] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:32:59 2021] DELETE /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:32:59.605067 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-9571f360-24eb-4eb0-a0db-e0b067bfea12 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:32:59.606307 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-9571f360-24eb-4eb0-a0db-e0b067bfea12 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:32:59.613037 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9571f360-24eb-4eb0-a0db-e0b067bfea12 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:59.613636 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9571f360-24eb-4eb0-a0db-e0b067bfea12 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:59.614998 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9571f360-24eb-4eb0-a0db-e0b067bfea12 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:32:59.615430 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9571f360-24eb-4eb0-a0db-e0b067bfea12 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:32:59.851779 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-9571f360-24eb-4eb0-a0db-e0b067bfea12 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:32:59.861722 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-9571f360-24eb-4eb0-a0db-e0b067bfea12 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9" status: 200 len: 1515 microversion: 2.1 time: 0.260059 Dec 20 03:32:59.862416 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 280/572] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:32:59 2021] GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 => generated 1515 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:00.151316 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a9716517-3a93-4f6f-853f-f14a8045303d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:00.152704 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a9716517-3a93-4f6f-853f-f14a8045303d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:00.160788 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a9716517-3a93-4f6f-853f-f14a8045303d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:00.162950 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a9716517-3a93-4f6f-853f-f14a8045303d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:00.164120 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a9716517-3a93-4f6f-853f-f14a8045303d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:00.164695 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a9716517-3a93-4f6f-853f-f14a8045303d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:00.271959 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-36ceb0af-319a-4be6-9ce1-f1b553a391a9 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:00.272887 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-36ceb0af-319a-4be6-9ce1-f1b553a391a9 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:00.283837 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-36ceb0af-319a-4be6-9ce1-f1b553a391a9 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:00.284611 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-36ceb0af-319a-4be6-9ce1-f1b553a391a9 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:00.286066 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-36ceb0af-319a-4be6-9ce1-f1b553a391a9 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:00.287262 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-36ceb0af-319a-4be6-9ce1-f1b553a391a9 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:00.494626 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-36ceb0af-319a-4be6-9ce1-f1b553a391a9 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:00.498115 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-a9716517-3a93-4f6f-853f-f14a8045303d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:00.506296 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-36ceb0af-319a-4be6-9ce1-f1b553a391a9 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1356 microversion: 2.1 time: 0.244148 Dec 20 03:33:00.506879 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 281/573] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:00 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1356 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:00.512095 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a9716517-3a93-4f6f-853f-f14a8045303d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1568 microversion: 2.1 time: 0.365137 Dec 20 03:33:00.526065 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 293/574] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:00 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1568 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:00.528976 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-5b0ddcc9-0f54-4b47-81bf-925935eb473a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:00.529885 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-5b0ddcc9-0f54-4b47-81bf-925935eb473a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:00.538183 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5b0ddcc9-0f54-4b47-81bf-925935eb473a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:00.539170 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5b0ddcc9-0f54-4b47-81bf-925935eb473a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:00.540025 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5b0ddcc9-0f54-4b47-81bf-925935eb473a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:00.540427 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5b0ddcc9-0f54-4b47-81bf-925935eb473a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:00.741993 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-5b0ddcc9-0f54-4b47-81bf-925935eb473a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:00.750391 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-5b0ddcc9-0f54-4b47-81bf-925935eb473a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1270 microversion: 2.1 time: 0.226133 Dec 20 03:33:00.750980 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 282/575] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:00 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1270 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:00.882007 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-5aa2370c-fd58-4e80-a20f-a2e81711760d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:00.882654 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-5aa2370c-fd58-4e80-a20f-a2e81711760d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:00.892084 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5aa2370c-fd58-4e80-a20f-a2e81711760d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:00.896214 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5aa2370c-fd58-4e80-a20f-a2e81711760d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:00.896214 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5aa2370c-fd58-4e80-a20f-a2e81711760d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:00.896214 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5aa2370c-fd58-4e80-a20f-a2e81711760d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:01.117583 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-5aa2370c-fd58-4e80-a20f-a2e81711760d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:01.127086 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-5aa2370c-fd58-4e80-a20f-a2e81711760d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9" status: 200 len: 1515 microversion: 2.1 time: 0.250657 Dec 20 03:33:01.127747 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 294/576] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:00 2021] GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 => generated 1515 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:01.279751 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-b3d035e8-86f2-4929-9f1e-221a253269db req-f9442919-d7ff-423d-a147-834c94774c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc84db6-8d02-4fd4-b38c-c0a90f104993", "tag": "dcafb0f8-ea15-4cf6-ace1-0817393056e3"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:01.281753 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:33:01.281753 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:33:01.296487 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-b3d035e8-86f2-4929-9f1e-221a253269db req-f9442919-d7ff-423d-a147-834c94774c42 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:01.297338 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-b3d035e8-86f2-4929-9f1e-221a253269db req-f9442919-d7ff-423d-a147-834c94774c42 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:01.329354 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-b3d035e8-86f2-4929-9f1e-221a253269db req-f9442919-d7ff-423d-a147-834c94774c42 service nova] Creating event network-changed:dcafb0f8-ea15-4cf6-ace1-0817393056e3 for instance 3cc84db6-8d02-4fd4-b38c-c0a90f104993 on hv-cinder-81803 Dec 20 03:33:01.336593 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-b3d035e8-86f2-4929-9f1e-221a253269db req-f9442919-d7ff-423d-a147-834c94774c42 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060041 Dec 20 03:33:01.337617 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 283/577] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:33:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:33:01.529533 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f4079bb3-ac18-4f3b-a69c-ff9b5f0aab14 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:01.530130 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-f4079bb3-ac18-4f3b-a69c-ff9b5f0aab14 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:01.531601 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7aa8193d-17d0-4978-b567-153588d67a86 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:01.533050 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-7aa8193d-17d0-4978-b567-153588d67a86 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:01.537460 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f4079bb3-ac18-4f3b-a69c-ff9b5f0aab14 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:01.538227 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f4079bb3-ac18-4f3b-a69c-ff9b5f0aab14 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:01.539212 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f4079bb3-ac18-4f3b-a69c-ff9b5f0aab14 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:01.540770 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f4079bb3-ac18-4f3b-a69c-ff9b5f0aab14 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:01.546203 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7aa8193d-17d0-4978-b567-153588d67a86 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:01.546747 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7aa8193d-17d0-4978-b567-153588d67a86 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:01.547686 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7aa8193d-17d0-4978-b567-153588d67a86 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:01.548545 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7aa8193d-17d0-4978-b567-153588d67a86 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:01.706841 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7aa8193d-17d0-4978-b567-153588d67a86 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:01.717074 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7aa8193d-17d0-4978-b567-153588d67a86 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1548 microversion: 2.1 time: 0.190060 Dec 20 03:33:01.717692 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 284/578] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:01 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1548 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:01.735082 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-fbce55b5-ca44-4d69-8f15-a02250c4a06d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:01.735618 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-fbce55b5-ca44-4d69-8f15-a02250c4a06d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:01.742777 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fbce55b5-ca44-4d69-8f15-a02250c4a06d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:01.743415 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fbce55b5-ca44-4d69-8f15-a02250c4a06d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:01.744050 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fbce55b5-ca44-4d69-8f15-a02250c4a06d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:01.744491 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fbce55b5-ca44-4d69-8f15-a02250c4a06d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:01.776107 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-f4079bb3-ac18-4f3b-a69c-ff9b5f0aab14 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:01.784266 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f4079bb3-ac18-4f3b-a69c-ff9b5f0aab14 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1356 microversion: 2.1 time: 0.258352 Dec 20 03:33:01.785000 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 295/579] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:01 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1356 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:01.794465 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e1807290-a479-4e76-b480-b207c1ffa0e0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:01.795101 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e1807290-a479-4e76-b480-b207c1ffa0e0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:01.808248 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e1807290-a479-4e76-b480-b207c1ffa0e0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:01.808824 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e1807290-a479-4e76-b480-b207c1ffa0e0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:01.809678 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e1807290-a479-4e76-b480-b207c1ffa0e0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:01.810115 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e1807290-a479-4e76-b480-b207c1ffa0e0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:01.841942 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-fbce55b5-ca44-4d69-8f15-a02250c4a06d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] HTTP exception thrown: Cannot 'detach_volume' instance 4e5cfe95-9804-4406-a893-82b021de3826 while it is in vm_state rescued Dec 20 03:33:01.842555 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-fbce55b5-ca44-4d69-8f15-a02250c4a06d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Returning 409 to user: Cannot 'detach_volume' instance 4e5cfe95-9804-4406-a893-82b021de3826 while it is in vm_state rescued {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:33:01.843388 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-fbce55b5-ca44-4d69-8f15-a02250c4a06d tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "DELETE /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/os-volume_attachments/ed75bdfd-6e66-49c4-8d0f-5498af8af63a" status: 409 len: 152 microversion: 2.1 time: 0.112598 Dec 20 03:33:01.843955 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 285/580] 10.222.0.53 () {58 vars in 1415 bytes} [Mon Dec 20 03:33:01 2021] DELETE /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/os-volume_attachments/ed75bdfd-6e66-49c4-8d0f-5498af8af63a => generated 152 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 20 03:33:01.869781 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e9859034-ddef-4485-aa13-cc637aa39a80 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:01.870795 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e9859034-ddef-4485-aa13-cc637aa39a80 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:01.888960 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e9859034-ddef-4485-aa13-cc637aa39a80 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:01.889846 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e9859034-ddef-4485-aa13-cc637aa39a80 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:01.891629 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e9859034-ddef-4485-aa13-cc637aa39a80 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:01.892545 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e9859034-ddef-4485-aa13-cc637aa39a80 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:02.101001 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-e1807290-a479-4e76-b480-b207c1ffa0e0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:02.108673 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e1807290-a479-4e76-b480-b207c1ffa0e0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1258 microversion: 2.1 time: 0.322802 Dec 20 03:33:02.109450 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 296/581] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:01 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1258 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:02.145364 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b982c111-9ba0-4e38-a6e1-92077a661911 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:02.146594 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-b982c111-9ba0-4e38-a6e1-92077a661911 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:02.153471 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b982c111-9ba0-4e38-a6e1-92077a661911 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:02.154873 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b982c111-9ba0-4e38-a6e1-92077a661911 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:02.156430 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b982c111-9ba0-4e38-a6e1-92077a661911 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:02.156866 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b982c111-9ba0-4e38-a6e1-92077a661911 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:02.165920 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e9859034-ddef-4485-aa13-cc637aa39a80 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "POST /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/action" status: 202 len: 0 microversion: 2.1 time: 0.302991 Dec 20 03:33:02.167178 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 286/582] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:33:01 2021] POST /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:33:02.178631 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f5658aec-62e3-4697-9084-fdd763a54b4b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:02.181555 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f5658aec-62e3-4697-9084-fdd763a54b4b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:02.196841 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f5658aec-62e3-4697-9084-fdd763a54b4b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:02.197330 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f5658aec-62e3-4697-9084-fdd763a54b4b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:02.198133 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f5658aec-62e3-4697-9084-fdd763a54b4b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:02.200037 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f5658aec-62e3-4697-9084-fdd763a54b4b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:02.414458 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b982c111-9ba0-4e38-a6e1-92077a661911 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:02.422712 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b982c111-9ba0-4e38-a6e1-92077a661911 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9" status: 200 len: 1515 microversion: 2.1 time: 0.281591 Dec 20 03:33:02.423305 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 297/583] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:02 2021] GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 => generated 1515 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:33:02.722948 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-f5658aec-62e3-4697-9084-fdd763a54b4b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:02.732135 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f5658aec-62e3-4697-9084-fdd763a54b4b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1556 microversion: 2.1 time: 0.560264 Dec 20 03:33:02.734269 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 287/584] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:02 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1556 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:02.790475 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-f5b36a64-40e2-470e-b84f-52bdb2cdc6e7 req-79885547-453d-4b7d-951a-dd5b576e1dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbefc305-fd32-4fa9-9c3a-1c4e53b716b9", "name": "network-vif-deleted", "tag": "e4415830-c355-4d6e-a000-020a900363fb"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:02.792089 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:33:02.792089 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:33:02.804960 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-16652e2b-0325-488c-b230-8025f0bc090e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:02.805823 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-16652e2b-0325-488c-b230-8025f0bc090e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:02.809057 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-f5b36a64-40e2-470e-b84f-52bdb2cdc6e7 req-79885547-453d-4b7d-951a-dd5b576e1dec service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:02.809748 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-f5b36a64-40e2-470e-b84f-52bdb2cdc6e7 req-79885547-453d-4b7d-951a-dd5b576e1dec service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:02.813640 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-16652e2b-0325-488c-b230-8025f0bc090e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:02.814106 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-16652e2b-0325-488c-b230-8025f0bc090e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:02.814914 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-16652e2b-0325-488c-b230-8025f0bc090e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:02.815356 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-16652e2b-0325-488c-b230-8025f0bc090e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:02.828159 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-f5b36a64-40e2-470e-b84f-52bdb2cdc6e7 req-79885547-453d-4b7d-951a-dd5b576e1dec service nova] Creating event network-vif-deleted:e4415830-c355-4d6e-a000-020a900363fb for instance bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 on hv-cinder-81803 Dec 20 03:33:02.843171 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-f5b36a64-40e2-470e-b84f-52bdb2cdc6e7 req-79885547-453d-4b7d-951a-dd5b576e1dec service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057048 Dec 20 03:33:02.850089 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 298/585] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:33:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:33:03.097598 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-16652e2b-0325-488c-b230-8025f0bc090e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:03.103483 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-16652e2b-0325-488c-b230-8025f0bc090e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1356 microversion: 2.1 time: 0.302064 Dec 20 03:33:03.104509 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 288/586] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:02 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1356 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:33:03.130418 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-7ad5cbb4-da2e-496f-ae45-f7504d1ae99c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:03.131607 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-7ad5cbb4-da2e-496f-ae45-f7504d1ae99c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:03.138969 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7ad5cbb4-da2e-496f-ae45-f7504d1ae99c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:03.139837 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7ad5cbb4-da2e-496f-ae45-f7504d1ae99c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:03.140933 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7ad5cbb4-da2e-496f-ae45-f7504d1ae99c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:03.141628 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7ad5cbb4-da2e-496f-ae45-f7504d1ae99c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:03.314986 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-7ad5cbb4-da2e-496f-ae45-f7504d1ae99c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:03.339899 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-7ad5cbb4-da2e-496f-ae45-f7504d1ae99c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1258 microversion: 2.1 time: 0.215060 Dec 20 03:33:03.349989 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 299/587] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:03 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1258 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:03.441477 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-183009da-3c56-464c-ae89-e424b6bfb73d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:03.442460 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-183009da-3c56-464c-ae89-e424b6bfb73d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:03.449094 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-183009da-3c56-464c-ae89-e424b6bfb73d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:03.449640 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-183009da-3c56-464c-ae89-e424b6bfb73d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:03.450448 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-183009da-3c56-464c-ae89-e424b6bfb73d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:03.450890 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-183009da-3c56-464c-ae89-e424b6bfb73d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:03.483439 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-183009da-3c56-464c-ae89-e424b6bfb73d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:03.483894 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-183009da-3c56-464c-ae89-e424b6bfb73d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:03.484357 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.objects.instance [None req-183009da-3c56-464c-ae89-e424b6bfb73d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lazy-loading 'fault' on Instance uuid bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 {{(pid=117012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:33:03.525260 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-183009da-3c56-464c-ae89-e424b6bfb73d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:03.532828 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-183009da-3c56-464c-ae89-e424b6bfb73d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9" status: 200 len: 1309 microversion: 2.1 time: 0.095737 Dec 20 03:33:03.533619 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 289/588] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:03 2021] GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:03.753752 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0c978e07-331f-454d-b187-55c04fb2332c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:03.754885 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-0c978e07-331f-454d-b187-55c04fb2332c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:03.766196 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0c978e07-331f-454d-b187-55c04fb2332c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:03.771262 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0c978e07-331f-454d-b187-55c04fb2332c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:03.771262 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0c978e07-331f-454d-b187-55c04fb2332c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:03.771262 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0c978e07-331f-454d-b187-55c04fb2332c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:03.954574 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-0c978e07-331f-454d-b187-55c04fb2332c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:03.963161 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-0c978e07-331f-454d-b187-55c04fb2332c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1556 microversion: 2.1 time: 0.215566 Dec 20 03:33:03.963725 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 300/589] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:03 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1556 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:04.120907 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d88043e9-6b0f-4c36-ad26-809fe5ba4ab5 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:04.121587 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d88043e9-6b0f-4c36-ad26-809fe5ba4ab5 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:04.127990 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d88043e9-6b0f-4c36-ad26-809fe5ba4ab5 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:04.128475 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d88043e9-6b0f-4c36-ad26-809fe5ba4ab5 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:04.129309 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d88043e9-6b0f-4c36-ad26-809fe5ba4ab5 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:04.130467 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d88043e9-6b0f-4c36-ad26-809fe5ba4ab5 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:04.278791 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d88043e9-6b0f-4c36-ad26-809fe5ba4ab5 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:04.287012 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d88043e9-6b0f-4c36-ad26-809fe5ba4ab5 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1356 microversion: 2.1 time: 0.169622 Dec 20 03:33:04.287595 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 290/590] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:04 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1356 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:04.357088 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-74dbdf3e-0029-4a81-a832-38858fe61b87 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:04.357723 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-74dbdf3e-0029-4a81-a832-38858fe61b87 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:04.364557 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-74dbdf3e-0029-4a81-a832-38858fe61b87 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:04.365121 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-74dbdf3e-0029-4a81-a832-38858fe61b87 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:04.366130 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-74dbdf3e-0029-4a81-a832-38858fe61b87 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:04.366561 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-74dbdf3e-0029-4a81-a832-38858fe61b87 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:04.519388 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-74dbdf3e-0029-4a81-a832-38858fe61b87 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:04.528324 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-74dbdf3e-0029-4a81-a832-38858fe61b87 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1258 microversion: 2.1 time: 0.175087 Dec 20 03:33:04.528920 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 301/591] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:04 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:04.552199 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-45c50d94-31c4-44c7-ba7e-c082a21ce054 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:04.552695 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-45c50d94-31c4-44c7-ba7e-c082a21ce054 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: bbefc305-fd32-4fa9-9c3a-1c4e53b716b9] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:04.561387 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-45c50d94-31c4-44c7-ba7e-c082a21ce054 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:04.561387 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-45c50d94-31c4-44c7-ba7e-c082a21ce054 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:04.561387 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-45c50d94-31c4-44c7-ba7e-c082a21ce054 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:04.561387 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-45c50d94-31c4-44c7-ba7e-c082a21ce054 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:04.575358 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-45c50d94-31c4-44c7-ba7e-c082a21ce054 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] HTTP exception thrown: Instance bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 could not be found. Dec 20 03:33:04.575963 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-45c50d94-31c4-44c7-ba7e-c082a21ce054 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Returning 404 to user: Instance bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:33:04.576870 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-45c50d94-31c4-44c7-ba7e-c082a21ce054 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9" status: 404 len: 111 microversion: 2.1 time: 0.028614 Dec 20 03:33:04.577477 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 291/592] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:04 2021] GET /compute/v2.1/servers/bbefc305-fd32-4fa9-9c3a-1c4e53b716b9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:33:04.841526 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-2b02ff49-7e25-4b4b-97da-c3499888c0a9 req-40a0d8d0-2dd6-4d66-aadb-2f98835d5ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2dfd907-6eb9-4420-b9dc-36fa0518d29a", "name": "network-vif-plugged", "status": "completed", "tag": "252e4b81-2b8b-4472-b0f9-0b2a9b974c88"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:04.843252 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:33:04.843252 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:33:04.853330 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-2b02ff49-7e25-4b4b-97da-c3499888c0a9 req-40a0d8d0-2dd6-4d66-aadb-2f98835d5ac8 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:04.853330 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-2b02ff49-7e25-4b4b-97da-c3499888c0a9 req-40a0d8d0-2dd6-4d66-aadb-2f98835d5ac8 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:04.866314 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-2b02ff49-7e25-4b4b-97da-c3499888c0a9 req-40a0d8d0-2dd6-4d66-aadb-2f98835d5ac8 service nova] Creating event network-vif-plugged:252e4b81-2b8b-4472-b0f9-0b2a9b974c88 for instance d2dfd907-6eb9-4420-b9dc-36fa0518d29a on hv-cinder-81803 Dec 20 03:33:04.871352 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-2b02ff49-7e25-4b4b-97da-c3499888c0a9 req-40a0d8d0-2dd6-4d66-aadb-2f98835d5ac8 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033884 Dec 20 03:33:04.871957 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 302/593] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:33:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:33:04.983307 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a11ad44c-0bae-4fd7-9199-acec46b1f9fd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:04.983968 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a11ad44c-0bae-4fd7-9199-acec46b1f9fd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:04.994802 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a11ad44c-0bae-4fd7-9199-acec46b1f9fd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:04.995628 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a11ad44c-0bae-4fd7-9199-acec46b1f9fd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:04.996561 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a11ad44c-0bae-4fd7-9199-acec46b1f9fd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:04.997594 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a11ad44c-0bae-4fd7-9199-acec46b1f9fd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:05.169936 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-a11ad44c-0bae-4fd7-9199-acec46b1f9fd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:05.184089 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a11ad44c-0bae-4fd7-9199-acec46b1f9fd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1556 microversion: 2.1 time: 0.207115 Dec 20 03:33:05.184675 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 292/594] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:04 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1556 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:05.305005 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f2418a14-cad3-4c1f-94a4-32b042a2658e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:05.306463 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-f2418a14-cad3-4c1f-94a4-32b042a2658e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:05.312923 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f2418a14-cad3-4c1f-94a4-32b042a2658e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:05.313405 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f2418a14-cad3-4c1f-94a4-32b042a2658e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:05.314179 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f2418a14-cad3-4c1f-94a4-32b042a2658e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:05.314622 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f2418a14-cad3-4c1f-94a4-32b042a2658e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:05.455619 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-f2418a14-cad3-4c1f-94a4-32b042a2658e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:05.464044 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f2418a14-cad3-4c1f-94a4-32b042a2658e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1356 microversion: 2.1 time: 0.163946 Dec 20 03:33:05.464604 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 303/595] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:05 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:05.545942 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-0be0802a-05f9-4028-acd4-c2051475a69b tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:05.546603 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-0be0802a-05f9-4028-acd4-c2051475a69b tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:05.553202 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0be0802a-05f9-4028-acd4-c2051475a69b tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:05.553674 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0be0802a-05f9-4028-acd4-c2051475a69b tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:05.554475 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0be0802a-05f9-4028-acd4-c2051475a69b tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:05.554914 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0be0802a-05f9-4028-acd4-c2051475a69b tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:05.712247 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0be0802a-05f9-4028-acd4-c2051475a69b tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:05.720028 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-0be0802a-05f9-4028-acd4-c2051475a69b tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1258 microversion: 2.1 time: 0.177792 Dec 20 03:33:05.720602 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 293/596] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:05 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:06.200516 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-28734c16-0323-40d8-a45c-a5445849794f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:06.201120 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-28734c16-0323-40d8-a45c-a5445849794f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:06.207312 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-28734c16-0323-40d8-a45c-a5445849794f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:06.208366 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-28734c16-0323-40d8-a45c-a5445849794f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:06.209367 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-28734c16-0323-40d8-a45c-a5445849794f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:06.209809 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-28734c16-0323-40d8-a45c-a5445849794f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:06.351749 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-28734c16-0323-40d8-a45c-a5445849794f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:06.359214 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-28734c16-0323-40d8-a45c-a5445849794f tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1562 microversion: 2.1 time: 0.162504 Dec 20 03:33:06.359799 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 304/597] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:06 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:06.429703 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d991b48f-f9d4-49d4-8eb2-c361ee96c76b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:06.430306 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d991b48f-f9d4-49d4-8eb2-c361ee96c76b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:06.436300 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d991b48f-f9d4-49d4-8eb2-c361ee96c76b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:06.436747 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d991b48f-f9d4-49d4-8eb2-c361ee96c76b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:06.437642 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d991b48f-f9d4-49d4-8eb2-c361ee96c76b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:06.438107 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d991b48f-f9d4-49d4-8eb2-c361ee96c76b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:06.482162 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-9aa0a18e-d7ab-4bde-a9be-7aca35379726 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:06.482798 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-9aa0a18e-d7ab-4bde-a9be-7aca35379726 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:06.489472 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9aa0a18e-d7ab-4bde-a9be-7aca35379726 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:06.489975 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9aa0a18e-d7ab-4bde-a9be-7aca35379726 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:06.490867 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9aa0a18e-d7ab-4bde-a9be-7aca35379726 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:06.491482 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9aa0a18e-d7ab-4bde-a9be-7aca35379726 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:06.528080 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.objects.instance [None req-d991b48f-f9d4-49d4-8eb2-c361ee96c76b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lazy-loading 'services' on Instance uuid 4e5cfe95-9804-4406-a893-82b021de3826 {{(pid=117012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:33:06.627443 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9aa0a18e-d7ab-4bde-a9be-7aca35379726 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:06.635800 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-9aa0a18e-d7ab-4bde-a9be-7aca35379726 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1356 microversion: 2.1 time: 0.157456 Dec 20 03:33:06.636719 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 305/598] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:06 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:33:06.737594 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b5f1a189-069c-40a9-9a24-f0fc142d082d tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:06.738205 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-b5f1a189-069c-40a9-9a24-f0fc142d082d tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:06.745421 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b5f1a189-069c-40a9-9a24-f0fc142d082d tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:06.745874 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b5f1a189-069c-40a9-9a24-f0fc142d082d tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:06.746658 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b5f1a189-069c-40a9-9a24-f0fc142d082d tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:06.747088 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b5f1a189-069c-40a9-9a24-f0fc142d082d tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:06.761565 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d991b48f-f9d4-49d4-8eb2-c361ee96c76b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "DELETE /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/os-volume_attachments/ed75bdfd-6e66-49c4-8d0f-5498af8af63a" status: 202 len: 0 microversion: 2.1 time: 0.336045 Dec 20 03:33:06.762178 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 294/599] 10.222.0.53 () {58 vars in 1415 bytes} [Mon Dec 20 03:33:06 2021] DELETE /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/os-volume_attachments/ed75bdfd-6e66-49c4-8d0f-5498af8af63a => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:33:06.771206 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-2a4045b2-320f-4c00-8248-b052aa1d9448 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:06.772308 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-2a4045b2-320f-4c00-8248-b052aa1d9448 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:06.778718 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2a4045b2-320f-4c00-8248-b052aa1d9448 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:06.779165 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2a4045b2-320f-4c00-8248-b052aa1d9448 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:06.779958 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2a4045b2-320f-4c00-8248-b052aa1d9448 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:06.780396 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2a4045b2-320f-4c00-8248-b052aa1d9448 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:06.815388 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-2a4045b2-320f-4c00-8248-b052aa1d9448 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048373 Dec 20 03:33:06.816010 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 295/600] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:33:06 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:33:06.900395 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b5f1a189-069c-40a9-9a24-f0fc142d082d tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:06.907739 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b5f1a189-069c-40a9-9a24-f0fc142d082d tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1258 microversion: 2.1 time: 0.174018 Dec 20 03:33:06.908299 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 306/601] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:06 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:33:07.652411 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7da6ca40-3b04-4b4d-9d54-5b636f1643d4 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:07.653017 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-7da6ca40-3b04-4b4d-9d54-5b636f1643d4 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:07.659703 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7da6ca40-3b04-4b4d-9d54-5b636f1643d4 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:07.660157 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7da6ca40-3b04-4b4d-9d54-5b636f1643d4 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:07.661524 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7da6ca40-3b04-4b4d-9d54-5b636f1643d4 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:07.661990 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7da6ca40-3b04-4b4d-9d54-5b636f1643d4 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:07.813543 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7da6ca40-3b04-4b4d-9d54-5b636f1643d4 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:07.821662 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7da6ca40-3b04-4b4d-9d54-5b636f1643d4 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1356 microversion: 2.1 time: 0.172904 Dec 20 03:33:07.831253 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 296/602] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:07 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1356 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:07.834427 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0802c585-0793-4c32-9923-4f1020572372 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:07.836333 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-0802c585-0793-4c32-9923-4f1020572372 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:07.849648 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0802c585-0793-4c32-9923-4f1020572372 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:07.852007 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0802c585-0793-4c32-9923-4f1020572372 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:07.852386 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0802c585-0793-4c32-9923-4f1020572372 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:07.852861 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0802c585-0793-4c32-9923-4f1020572372 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:07.912000 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-0802c585-0793-4c32-9923-4f1020572372 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085378 Dec 20 03:33:07.913103 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 307/603] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:33:07 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:33:07.925890 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d4e57be2-b5c6-44c0-9c68-e78ad810ca82 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:07.927119 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d4e57be2-b5c6-44c0-9c68-e78ad810ca82 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:07.933717 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d4e57be2-b5c6-44c0-9c68-e78ad810ca82 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:07.934169 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d4e57be2-b5c6-44c0-9c68-e78ad810ca82 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:07.934973 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d4e57be2-b5c6-44c0-9c68-e78ad810ca82 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:07.935418 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d4e57be2-b5c6-44c0-9c68-e78ad810ca82 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:08.095269 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d4e57be2-b5c6-44c0-9c68-e78ad810ca82 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:08.102931 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d4e57be2-b5c6-44c0-9c68-e78ad810ca82 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1258 microversion: 2.1 time: 0.180882 Dec 20 03:33:08.103504 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 297/604] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:07 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1258 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:08.838998 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-fb302721-c453-4f0b-9ea8-b6a857a995e1 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:08.839959 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-fb302721-c453-4f0b-9ea8-b6a857a995e1 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:08.846981 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fb302721-c453-4f0b-9ea8-b6a857a995e1 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:08.847503 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fb302721-c453-4f0b-9ea8-b6a857a995e1 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:08.849106 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fb302721-c453-4f0b-9ea8-b6a857a995e1 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:08.849905 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fb302721-c453-4f0b-9ea8-b6a857a995e1 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:08.923833 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-347d3247-4b88-46e7-b965-c72f74aef24e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:08.924837 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-347d3247-4b88-46e7-b965-c72f74aef24e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:08.931480 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-347d3247-4b88-46e7-b965-c72f74aef24e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:08.931942 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-347d3247-4b88-46e7-b965-c72f74aef24e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:08.932760 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-347d3247-4b88-46e7-b965-c72f74aef24e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:08.933226 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-347d3247-4b88-46e7-b965-c72f74aef24e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:08.963869 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-347d3247-4b88-46e7-b965-c72f74aef24e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043769 Dec 20 03:33:08.964641 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 298/605] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:33:08 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:33:08.991249 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-fb302721-c453-4f0b-9ea8-b6a857a995e1 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:08.998921 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-fb302721-c453-4f0b-9ea8-b6a857a995e1 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1356 microversion: 2.1 time: 0.163536 Dec 20 03:33:08.999499 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 308/606] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:08 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:09.120449 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-0b6c0eb4-ae0b-4756-84c5-0f1aacbcdde3 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:09.121087 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-0b6c0eb4-ae0b-4756-84c5-0f1aacbcdde3 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:09.127831 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0b6c0eb4-ae0b-4756-84c5-0f1aacbcdde3 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:09.128290 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0b6c0eb4-ae0b-4756-84c5-0f1aacbcdde3 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:09.129086 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0b6c0eb4-ae0b-4756-84c5-0f1aacbcdde3 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:09.130294 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0b6c0eb4-ae0b-4756-84c5-0f1aacbcdde3 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:09.302538 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0b6c0eb4-ae0b-4756-84c5-0f1aacbcdde3 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:09.312073 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-0b6c0eb4-ae0b-4756-84c5-0f1aacbcdde3 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1258 microversion: 2.1 time: 0.195004 Dec 20 03:33:09.312737 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 299/607] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:09 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1258 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:33:09.975889 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-be0f9981-33ab-474c-a4a4-efdfb8ee30ed tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:09.976764 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-be0f9981-33ab-474c-a4a4-efdfb8ee30ed tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:09.983305 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-be0f9981-33ab-474c-a4a4-efdfb8ee30ed tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:09.983751 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-be0f9981-33ab-474c-a4a4-efdfb8ee30ed tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:09.984542 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-be0f9981-33ab-474c-a4a4-efdfb8ee30ed tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:09.984976 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-be0f9981-33ab-474c-a4a4-efdfb8ee30ed tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:10.015290 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-be0f9981-33ab-474c-a4a4-efdfb8ee30ed tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043739 Dec 20 03:33:10.015898 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 309/608] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:33:09 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 03:33:10.016441 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7b12528f-c8c8-4a90-bbde-6c4d419c6b62 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:10.017283 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-7b12528f-c8c8-4a90-bbde-6c4d419c6b62 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:10.024480 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7b12528f-c8c8-4a90-bbde-6c4d419c6b62 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:10.024914 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7b12528f-c8c8-4a90-bbde-6c4d419c6b62 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:10.025899 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7b12528f-c8c8-4a90-bbde-6c4d419c6b62 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:10.026507 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7b12528f-c8c8-4a90-bbde-6c4d419c6b62 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:10.199507 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7b12528f-c8c8-4a90-bbde-6c4d419c6b62 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:10.208117 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7b12528f-c8c8-4a90-bbde-6c4d419c6b62 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1544 microversion: 2.1 time: 0.195122 Dec 20 03:33:10.208711 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 300/609] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:10 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1544 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:33:10.225704 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f4a3ec28-95e9-410b-ba5d-f5c1b7668347 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:10.226379 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-f4a3ec28-95e9-410b-ba5d-f5c1b7668347 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:10.232575 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f4a3ec28-95e9-410b-ba5d-f5c1b7668347 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:10.233063 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f4a3ec28-95e9-410b-ba5d-f5c1b7668347 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:10.234132 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f4a3ec28-95e9-410b-ba5d-f5c1b7668347 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:10.234627 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f4a3ec28-95e9-410b-ba5d-f5c1b7668347 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:10.334184 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-53e72814-7ff4-4246-8884-4dc2bed79dcb tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:10.335305 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-53e72814-7ff4-4246-8884-4dc2bed79dcb tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:10.349693 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-53e72814-7ff4-4246-8884-4dc2bed79dcb tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:10.350376 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-53e72814-7ff4-4246-8884-4dc2bed79dcb tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:10.351333 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-53e72814-7ff4-4246-8884-4dc2bed79dcb tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:10.351955 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-53e72814-7ff4-4246-8884-4dc2bed79dcb tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:10.411898 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-f4a3ec28-95e9-410b-ba5d-f5c1b7668347 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:10.419920 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f4a3ec28-95e9-410b-ba5d-f5c1b7668347 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1544 microversion: 2.1 time: 0.198262 Dec 20 03:33:10.420501 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 310/610] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:10 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1544 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:10.436957 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b0e88fd8-1070-4ae9-a346-a79ca4fe9b1c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:10.441046 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:33:10.441046 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:33:10.442971 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b0e88fd8-1070-4ae9-a346-a79ca4fe9b1c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:10.443634 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-b0e88fd8-1070-4ae9-a346-a79ca4fe9b1c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Searching by: {'deleted': False, 'project_id': '74667b9b73e542e5a65f354d431c3b7a'} {{(pid=117011) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 20 03:33:10.451635 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b0e88fd8-1070-4ae9-a346-a79ca4fe9b1c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:10.456964 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b0e88fd8-1070-4ae9-a346-a79ca4fe9b1c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:10.456964 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b0e88fd8-1070-4ae9-a346-a79ca4fe9b1c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:10.456964 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b0e88fd8-1070-4ae9-a346-a79ca4fe9b1c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:10.544375 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-53e72814-7ff4-4246-8884-4dc2bed79dcb tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:10.553909 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-53e72814-7ff4-4246-8884-4dc2bed79dcb tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1258 microversion: 2.1 time: 0.226155 Dec 20 03:33:10.555010 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.multi_cell_list [None req-b0e88fd8-1070-4ae9-a346-a79ca4fe9b1c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117011) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 20 03:33:10.559601 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 301/611] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:10 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1258 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:10.663775 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b0e88fd8-1070-4ae9-a346-a79ca4fe9b1c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.230492 Dec 20 03:33:10.664811 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 311/612] 10.222.0.53 () {58 vars in 1124 bytes} [Mon Dec 20 03:33:10 2021] GET /compute/v2.1/servers => generated 342 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:33:10.674749 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c4c22b35-7a5f-41ea-8d6a-7a28e1ad3847 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:10.675357 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c4c22b35-7a5f-41ea-8d6a-7a28e1ad3847 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:10.681762 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c4c22b35-7a5f-41ea-8d6a-7a28e1ad3847 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:10.682445 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c4c22b35-7a5f-41ea-8d6a-7a28e1ad3847 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:10.683245 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c4c22b35-7a5f-41ea-8d6a-7a28e1ad3847 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:10.683677 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c4c22b35-7a5f-41ea-8d6a-7a28e1ad3847 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:10.839492 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c4c22b35-7a5f-41ea-8d6a-7a28e1ad3847 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:10.850189 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c4c22b35-7a5f-41ea-8d6a-7a28e1ad3847 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1544 microversion: 2.1 time: 0.179208 Dec 20 03:33:10.865444 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 302/613] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:10 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1544 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:11.571608 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-c40605b1-9662-4bb9-bb53-43c95d916183 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:11.572939 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-c40605b1-9662-4bb9-bb53-43c95d916183 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:11.582971 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c40605b1-9662-4bb9-bb53-43c95d916183 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:11.584268 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c40605b1-9662-4bb9-bb53-43c95d916183 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:11.585563 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c40605b1-9662-4bb9-bb53-43c95d916183 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:11.586263 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c40605b1-9662-4bb9-bb53-43c95d916183 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:11.784602 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-c40605b1-9662-4bb9-bb53-43c95d916183 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:11.811312 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-c40605b1-9662-4bb9-bb53-43c95d916183 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1258 microversion: 2.1 time: 0.243801 Dec 20 03:33:11.830730 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 312/614] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:11 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1258 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:12.833426 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7c9de5f1-96d4-408f-a91b-49d26708dfb9 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:12.834208 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-7c9de5f1-96d4-408f-a91b-49d26708dfb9 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:12.841454 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7c9de5f1-96d4-408f-a91b-49d26708dfb9 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:12.841910 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7c9de5f1-96d4-408f-a91b-49d26708dfb9 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:12.842708 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7c9de5f1-96d4-408f-a91b-49d26708dfb9 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:12.843139 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7c9de5f1-96d4-408f-a91b-49d26708dfb9 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:13.011484 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7c9de5f1-96d4-408f-a91b-49d26708dfb9 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:13.020672 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7c9de5f1-96d4-408f-a91b-49d26708dfb9 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1258 microversion: 2.1 time: 0.190428 Dec 20 03:33:13.023583 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 303/615] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:12 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1258 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:14.038710 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-efdd45f6-4ecc-448a-bf31-bc81987fd444 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:14.039550 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-efdd45f6-4ecc-448a-bf31-bc81987fd444 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:14.046454 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-efdd45f6-4ecc-448a-bf31-bc81987fd444 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:14.047004 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-efdd45f6-4ecc-448a-bf31-bc81987fd444 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:14.047796 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-efdd45f6-4ecc-448a-bf31-bc81987fd444 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:14.048257 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-efdd45f6-4ecc-448a-bf31-bc81987fd444 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:14.187589 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-efdd45f6-4ecc-448a-bf31-bc81987fd444 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:14.195950 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-efdd45f6-4ecc-448a-bf31-bc81987fd444 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1258 microversion: 2.1 time: 0.161131 Dec 20 03:33:14.196532 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 313/616] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:14 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:14.527449 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-9a509c99-70f8-43bc-bcb9-bd54b4833161 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:14.528355 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-9a509c99-70f8-43bc-bcb9-bd54b4833161 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:14.534993 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9a509c99-70f8-43bc-bcb9-bd54b4833161 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:14.535987 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9a509c99-70f8-43bc-bcb9-bd54b4833161 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:14.537076 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9a509c99-70f8-43bc-bcb9-bd54b4833161 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:14.537547 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9a509c99-70f8-43bc-bcb9-bd54b4833161 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:14.569631 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-9a509c99-70f8-43bc-bcb9-bd54b4833161 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045917 Dec 20 03:33:14.570219 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 304/617] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:33:14 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 20 03:33:14.630886 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-116b85d7-04a3-474b-bc36-6fd178452f47 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:14.631647 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-116b85d7-04a3-474b-bc36-6fd178452f47 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:14.637771 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-116b85d7-04a3-474b-bc36-6fd178452f47 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:14.638226 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-116b85d7-04a3-474b-bc36-6fd178452f47 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:14.639029 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-116b85d7-04a3-474b-bc36-6fd178452f47 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:14.639468 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-116b85d7-04a3-474b-bc36-6fd178452f47 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:14.664972 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-116b85d7-04a3-474b-bc36-6fd178452f47 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Going to try to terminate instance {{(pid=117011) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:33:15.037073 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-116b85d7-04a3-474b-bc36-6fd178452f47 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "DELETE /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 204 len: 0 microversion: 2.1 time: 0.408916 Dec 20 03:33:15.037800 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 314/618] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:33:14 2021] DELETE /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:33:15.046064 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-99130e29-ddea-4af0-8cf4-2da924a165c9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:15.047205 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-99130e29-ddea-4af0-8cf4-2da924a165c9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:15.055347 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-99130e29-ddea-4af0-8cf4-2da924a165c9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:15.055926 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-99130e29-ddea-4af0-8cf4-2da924a165c9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:15.056966 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-99130e29-ddea-4af0-8cf4-2da924a165c9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:15.057430 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-99130e29-ddea-4af0-8cf4-2da924a165c9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:15.139376 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d32cf9cd-2c38-425a-aed9-35cfaf3c6a6e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2952c68a-b5bb-484e-a33e-ca7ef419315a"}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:15.141227 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d32cf9cd-2c38-425a-aed9-35cfaf3c6a6e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:15.153554 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d32cf9cd-2c38-425a-aed9-35cfaf3c6a6e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:15.154403 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d32cf9cd-2c38-425a-aed9-35cfaf3c6a6e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:15.155409 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d32cf9cd-2c38-425a-aed9-35cfaf3c6a6e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:15.156331 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d32cf9cd-2c38-425a-aed9-35cfaf3c6a6e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:15.255131 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-99130e29-ddea-4af0-8cf4-2da924a165c9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:15.264567 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-99130e29-ddea-4af0-8cf4-2da924a165c9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1674 microversion: 2.1 time: 0.222018 Dec 20 03:33:15.265498 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 305/619] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:15 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1674 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:15.271457 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ea492cff-cce8-43aa-b31f-447220df5cf2 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:15.272310 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ea492cff-cce8-43aa-b31f-447220df5cf2 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:15.278872 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ea492cff-cce8-43aa-b31f-447220df5cf2 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:15.279340 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ea492cff-cce8-43aa-b31f-447220df5cf2 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:15.280391 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ea492cff-cce8-43aa-b31f-447220df5cf2 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:15.281061 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ea492cff-cce8-43aa-b31f-447220df5cf2 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:15.456917 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-ea492cff-cce8-43aa-b31f-447220df5cf2 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:15.469698 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ea492cff-cce8-43aa-b31f-447220df5cf2 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1258 microversion: 2.1 time: 0.202250 Dec 20 03:33:15.469867 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 306/620] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:15 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1258 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:15.475387 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-298c819a-0ab7-4daf-80a5-568f745cda82 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1435490352", "imageRef": "9c4ec443-915b-4997-82d3-08cc97ba635b", "flavorRef": "452", "networks": [{"uuid": "04fe64b7-d33c-4d47-90a3-8de2f67e8986"}]}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:15.541260 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.network.neutron [None req-298c819a-0ab7-4daf-80a5-568f745cda82 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] validate_networks() for [('04fe64b7-d33c-4d47-90a3-8de2f67e8986', None, None, None, None, None)] {{(pid=117012) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:33:15.921687 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-298c819a-0ab7-4daf-80a5-568f745cda82 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Flavor limits 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:33:15.922482 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-298c819a-0ab7-4daf-80a5-568f745cda82 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Image limits 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:33:15.922963 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-298c819a-0ab7-4daf-80a5-568f745cda82 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Flavor pref 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:33:15.923379 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-298c819a-0ab7-4daf-80a5-568f745cda82 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Image pref 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:33:15.923949 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-298c819a-0ab7-4daf-80a5-568f745cda82 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:33:15.933311 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-298c819a-0ab7-4daf-80a5-568f745cda82 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:15.933757 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-298c819a-0ab7-4daf-80a5-568f745cda82 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:15.934632 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-298c819a-0ab7-4daf-80a5-568f745cda82 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:15.935073 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-298c819a-0ab7-4daf-80a5-568f745cda82 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:15.952807 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-298c819a-0ab7-4daf-80a5-568f745cda82 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Getting quotas for project 52b3f51f2d0f44ffab57b6f7798b66ce. Resources: {'instances', 'ram', 'cores'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:33:15.956918 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-298c819a-0ab7-4daf-80a5-568f745cda82 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Getting quotas for user 4ccfa6b8be514860a43d28ea40638220 and project 52b3f51f2d0f44ffab57b6f7798b66ce. Resources: {'instances', 'ram', 'cores'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:33:15.969278 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-298c819a-0ab7-4daf-80a5-568f745cda82 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Going to run 1 instances... {{(pid=117012) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:33:15.971658 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-298c819a-0ab7-4daf-80a5-568f745cda82 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c4ec443-915b-4997-82d3-08cc97ba635b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117012) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:33:16.112836 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-298c819a-0ab7-4daf-80a5-568f745cda82 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641839 Dec 20 03:33:16.113796 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 307/621] 10.222.0.53 () {60 vars in 1146 bytes} [Mon Dec 20 03:33:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 03:33:16.118190 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e56b1e2b-e20d-4255-be4b-5fc46a6128f4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:16.119126 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e56b1e2b-e20d-4255-be4b-5fc46a6128f4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:16.125486 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e56b1e2b-e20d-4255-be4b-5fc46a6128f4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:16.125941 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e56b1e2b-e20d-4255-be4b-5fc46a6128f4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:16.126743 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e56b1e2b-e20d-4255-be4b-5fc46a6128f4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:16.127180 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e56b1e2b-e20d-4255-be4b-5fc46a6128f4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:16.132219 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d32cf9cd-2c38-425a-aed9-35cfaf3c6a6e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "POST /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.998214 Dec 20 03:33:16.133071 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 315/622] 10.222.0.53 () {60 vars in 1322 bytes} [Mon Dec 20 03:33:15 2021] POST /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a/os-volume_attachments => generated 194 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:33:16.151095 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-9b3344c8-5b07-4718-a87f-d536870a6e77 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:16.153446 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-9b3344c8-5b07-4718-a87f-d536870a6e77 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:16.164235 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e56b1e2b-e20d-4255-be4b-5fc46a6128f4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Going to try to terminate instance {{(pid=117012) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:33:16.234562 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9b3344c8-5b07-4718-a87f-d536870a6e77 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:16.242175 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-9b3344c8-5b07-4718-a87f-d536870a6e77 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282" status: 200 len: 1219 microversion: 2.1 time: 0.107388 Dec 20 03:33:16.246102 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 316/623] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:16 2021] GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282 => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:16.287211 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-19dfff3f-2c83-4472-b0f0-ad71bae3f997 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:16.287211 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-19dfff3f-2c83-4472-b0f0-ad71bae3f997 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:16.296077 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-19dfff3f-2c83-4472-b0f0-ad71bae3f997 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:16.296774 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-19dfff3f-2c83-4472-b0f0-ad71bae3f997 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:16.297798 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-19dfff3f-2c83-4472-b0f0-ad71bae3f997 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:16.298931 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-19dfff3f-2c83-4472-b0f0-ad71bae3f997 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:16.495888 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-19dfff3f-2c83-4472-b0f0-ad71bae3f997 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:16.505641 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-19dfff3f-2c83-4472-b0f0-ad71bae3f997 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1674 microversion: 2.1 time: 0.225621 Dec 20 03:33:16.506234 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 317/624] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:16 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1674 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:16.510701 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-8dbf50af-acbc-44a6-95ad-aedcf78dc254 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:16.511362 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-8dbf50af-acbc-44a6-95ad-aedcf78dc254 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:16.517581 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8dbf50af-acbc-44a6-95ad-aedcf78dc254 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:16.517738 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e56b1e2b-e20d-4255-be4b-5fc46a6128f4 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "DELETE /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 204 len: 0 microversion: 2.1 time: 0.402676 Dec 20 03:33:16.518041 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8dbf50af-acbc-44a6-95ad-aedcf78dc254 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:16.518290 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 308/625] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:33:16 2021] DELETE /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:33:16.518899 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8dbf50af-acbc-44a6-95ad-aedcf78dc254 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:16.519450 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8dbf50af-acbc-44a6-95ad-aedcf78dc254 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:16.529769 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-999e9609-6006-4999-a451-10a8d63feabe tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:16.531514 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-999e9609-6006-4999-a451-10a8d63feabe tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:16.537921 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-999e9609-6006-4999-a451-10a8d63feabe tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:16.538531 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-999e9609-6006-4999-a451-10a8d63feabe tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:16.539397 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-999e9609-6006-4999-a451-10a8d63feabe tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:16.539901 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-999e9609-6006-4999-a451-10a8d63feabe tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:16.694303 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-8dbf50af-acbc-44a6-95ad-aedcf78dc254 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:16.705973 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-8dbf50af-acbc-44a6-95ad-aedcf78dc254 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1258 microversion: 2.1 time: 0.198082 Dec 20 03:33:16.708104 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 318/626] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:16 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1258 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:16.748015 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-999e9609-6006-4999-a451-10a8d63feabe tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:16.753273 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-7655bc7c-49f5-4019-941b-5ad1f0861c44 req-f60a5a75-0d5d-46ee-9f42-d284125515e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc84db6-8d02-4fd4-b38c-c0a90f104993", "name": "network-vif-plugged", "status": "completed", "tag": "dcafb0f8-ea15-4cf6-ace1-0817393056e3"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:16.755854 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-999e9609-6006-4999-a451-10a8d63feabe tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1507 microversion: 2.1 time: 0.232352 Dec 20 03:33:16.756348 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:33:16.756348 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:33:16.756774 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 309/627] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:16 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1507 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:16.763998 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-7655bc7c-49f5-4019-941b-5ad1f0861c44 req-f60a5a75-0d5d-46ee-9f42-d284125515e0 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:16.764515 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-7655bc7c-49f5-4019-941b-5ad1f0861c44 req-f60a5a75-0d5d-46ee-9f42-d284125515e0 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:16.776570 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-7655bc7c-49f5-4019-941b-5ad1f0861c44 req-f60a5a75-0d5d-46ee-9f42-d284125515e0 service nova] Creating event network-vif-plugged:dcafb0f8-ea15-4cf6-ace1-0817393056e3 for instance 3cc84db6-8d02-4fd4-b38c-c0a90f104993 on hv-cinder-81803 Dec 20 03:33:16.781657 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-7655bc7c-49f5-4019-941b-5ad1f0861c44 req-f60a5a75-0d5d-46ee-9f42-d284125515e0 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033040 Dec 20 03:33:16.782312 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 319/628] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:33:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:33:17.263133 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-146f3e8d-6b9d-47a5-86b6-7ccb1f90db87 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:17.263798 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-146f3e8d-6b9d-47a5-86b6-7ccb1f90db87 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:17.270891 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-146f3e8d-6b9d-47a5-86b6-7ccb1f90db87 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:17.271461 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-146f3e8d-6b9d-47a5-86b6-7ccb1f90db87 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:17.272259 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-146f3e8d-6b9d-47a5-86b6-7ccb1f90db87 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:17.272698 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-146f3e8d-6b9d-47a5-86b6-7ccb1f90db87 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:17.352735 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-146f3e8d-6b9d-47a5-86b6-7ccb1f90db87 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:17.364617 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-146f3e8d-6b9d-47a5-86b6-7ccb1f90db87 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282" status: 200 len: 1223 microversion: 2.1 time: 0.108173 Dec 20 03:33:17.366079 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 310/629] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:17 2021] GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282 => generated 1223 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:17.524470 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-7b9642f5-2f71-45c1-8a78-78f04cee0666 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:17.525212 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-7b9642f5-2f71-45c1-8a78-78f04cee0666 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:17.531636 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7b9642f5-2f71-45c1-8a78-78f04cee0666 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:17.532133 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7b9642f5-2f71-45c1-8a78-78f04cee0666 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:17.532922 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7b9642f5-2f71-45c1-8a78-78f04cee0666 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:17.533391 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7b9642f5-2f71-45c1-8a78-78f04cee0666 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:17.679198 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-7b9642f5-2f71-45c1-8a78-78f04cee0666 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:17.686747 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-7b9642f5-2f71-45c1-8a78-78f04cee0666 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1674 microversion: 2.1 time: 0.167787 Dec 20 03:33:17.687320 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 320/630] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:17 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:17.723680 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-60f349ca-64ff-46c9-9c82-b6b17e9666f6 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:17.724310 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-60f349ca-64ff-46c9-9c82-b6b17e9666f6 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:17.730659 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-60f349ca-64ff-46c9-9c82-b6b17e9666f6 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:17.731103 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-60f349ca-64ff-46c9-9c82-b6b17e9666f6 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:17.731874 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-60f349ca-64ff-46c9-9c82-b6b17e9666f6 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:17.732308 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-60f349ca-64ff-46c9-9c82-b6b17e9666f6 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:17.772103 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ad5a5d91-fa5b-4f71-9bae-5dfb6426d179 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:17.772706 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ad5a5d91-fa5b-4f71-9bae-5dfb6426d179 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:17.778553 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ad5a5d91-fa5b-4f71-9bae-5dfb6426d179 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:17.778996 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ad5a5d91-fa5b-4f71-9bae-5dfb6426d179 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:17.779767 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ad5a5d91-fa5b-4f71-9bae-5dfb6426d179 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:17.780192 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ad5a5d91-fa5b-4f71-9bae-5dfb6426d179 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:17.905606 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-60f349ca-64ff-46c9-9c82-b6b17e9666f6 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:17.913582 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-60f349ca-64ff-46c9-9c82-b6b17e9666f6 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1258 microversion: 2.1 time: 0.193511 Dec 20 03:33:17.923309 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 311/631] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:17 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1258 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:17.936964 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ad5a5d91-fa5b-4f71-9bae-5dfb6426d179 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:17.945059 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ad5a5d91-fa5b-4f71-9bae-5dfb6426d179 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1507 microversion: 2.1 time: 0.177098 Dec 20 03:33:17.945669 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 321/632] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:17 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:33:18.392145 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-10a5531b-cf34-48e5-a69e-b97129019c84 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:18.392869 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-10a5531b-cf34-48e5-a69e-b97129019c84 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:18.399410 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-10a5531b-cf34-48e5-a69e-b97129019c84 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:18.400015 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-10a5531b-cf34-48e5-a69e-b97129019c84 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:18.400870 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-10a5531b-cf34-48e5-a69e-b97129019c84 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:18.401538 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-10a5531b-cf34-48e5-a69e-b97129019c84 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:18.529492 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-10a5531b-cf34-48e5-a69e-b97129019c84 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:18.537943 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-10a5531b-cf34-48e5-a69e-b97129019c84 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282" status: 200 len: 1271 microversion: 2.1 time: 0.149764 Dec 20 03:33:18.538535 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 312/633] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:18 2021] GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282 => generated 1271 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:18.703668 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-552e14c7-12f8-4563-b34b-f02cde6925f6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:18.704308 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-552e14c7-12f8-4563-b34b-f02cde6925f6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:18.712232 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-552e14c7-12f8-4563-b34b-f02cde6925f6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:18.712687 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-552e14c7-12f8-4563-b34b-f02cde6925f6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:18.713544 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-552e14c7-12f8-4563-b34b-f02cde6925f6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:18.713982 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-552e14c7-12f8-4563-b34b-f02cde6925f6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:18.878140 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-552e14c7-12f8-4563-b34b-f02cde6925f6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:18.892848 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-552e14c7-12f8-4563-b34b-f02cde6925f6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1674 microversion: 2.1 time: 0.192847 Dec 20 03:33:18.893461 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 322/634] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:18 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1674 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:18.936922 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-203cc170-7421-4fa3-9a83-f00e143a172a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:18.938179 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-203cc170-7421-4fa3-9a83-f00e143a172a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:18.946492 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-203cc170-7421-4fa3-9a83-f00e143a172a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:18.947513 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-203cc170-7421-4fa3-9a83-f00e143a172a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:18.948501 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-203cc170-7421-4fa3-9a83-f00e143a172a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:18.949112 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-203cc170-7421-4fa3-9a83-f00e143a172a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:18.965954 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b620a0a4-ef9e-4232-bf90-ddf3947bfee5 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:18.966569 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-b620a0a4-ef9e-4232-bf90-ddf3947bfee5 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:18.978720 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b620a0a4-ef9e-4232-bf90-ddf3947bfee5 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:18.979728 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b620a0a4-ef9e-4232-bf90-ddf3947bfee5 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:18.981195 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b620a0a4-ef9e-4232-bf90-ddf3947bfee5 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:18.982162 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b620a0a4-ef9e-4232-bf90-ddf3947bfee5 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:19.187240 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b620a0a4-ef9e-4232-bf90-ddf3947bfee5 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:19.196245 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b620a0a4-ef9e-4232-bf90-ddf3947bfee5 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1507 microversion: 2.1 time: 0.236069 Dec 20 03:33:19.197043 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 323/635] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:18 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1507 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:19.557594 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a7e30286-4fc9-4101-b142-8dcbffc17bcc tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:19.558464 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a7e30286-4fc9-4101-b142-8dcbffc17bcc tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:19.568141 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a7e30286-4fc9-4101-b142-8dcbffc17bcc tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:19.568792 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a7e30286-4fc9-4101-b142-8dcbffc17bcc tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:19.569915 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a7e30286-4fc9-4101-b142-8dcbffc17bcc tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:19.570493 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a7e30286-4fc9-4101-b142-8dcbffc17bcc tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:19.607719 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-203cc170-7421-4fa3-9a83-f00e143a172a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:19.615471 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-203cc170-7421-4fa3-9a83-f00e143a172a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1258 microversion: 2.1 time: 0.682124 Dec 20 03:33:19.616051 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 313/636] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:18 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1258 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:19.676706 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-a7e30286-4fc9-4101-b142-8dcbffc17bcc tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:19.688527 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-1ee56670-b5fd-4140-83d5-edb21445171e req-fb405e51-d3eb-43cb-9a79-37cbdd587263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ec437d6-633a-468c-aa6a-d4c81df62919", "name": "network-vif-deleted", "tag": "8052eace-4c6b-4e95-b6b9-e785e74cfa8a"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:19.690453 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:33:19.690453 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:33:19.704886 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-1ee56670-b5fd-4140-83d5-edb21445171e req-fb405e51-d3eb-43cb-9a79-37cbdd587263 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:19.705682 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-1ee56670-b5fd-4140-83d5-edb21445171e req-fb405e51-d3eb-43cb-9a79-37cbdd587263 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:19.708512 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a7e30286-4fc9-4101-b142-8dcbffc17bcc tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282" status: 200 len: 1289 microversion: 2.1 time: 0.155589 Dec 20 03:33:19.720728 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 324/637] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:19 2021] GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282 => generated 1289 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:19.730155 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-1ee56670-b5fd-4140-83d5-edb21445171e req-fb405e51-d3eb-43cb-9a79-37cbdd587263 service nova] Creating event network-vif-deleted:8052eace-4c6b-4e95-b6b9-e785e74cfa8a for instance 5ec437d6-633a-468c-aa6a-d4c81df62919 on hv-cinder-81803 Dec 20 03:33:19.741702 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-1ee56670-b5fd-4140-83d5-edb21445171e req-fb405e51-d3eb-43cb-9a79-37cbdd587263 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055933 Dec 20 03:33:19.742499 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 314/638] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:33:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:33:19.921014 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1f27534e-d449-4541-a0aa-95ec76771235 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:19.921806 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1f27534e-d449-4541-a0aa-95ec76771235 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:19.939134 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1f27534e-d449-4541-a0aa-95ec76771235 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:19.939597 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1f27534e-d449-4541-a0aa-95ec76771235 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:19.941057 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1f27534e-d449-4541-a0aa-95ec76771235 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:19.942197 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1f27534e-d449-4541-a0aa-95ec76771235 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:20.060220 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-1f27534e-d449-4541-a0aa-95ec76771235 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:20.074818 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1f27534e-d449-4541-a0aa-95ec76771235 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1323 microversion: 2.1 time: 0.158218 Dec 20 03:33:20.076099 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 325/639] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:19 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1323 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:20.220908 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-62cbb466-5897-445d-99f0-597dd22e9a49 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:20.222618 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-62cbb466-5897-445d-99f0-597dd22e9a49 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:20.251065 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-62cbb466-5897-445d-99f0-597dd22e9a49 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:20.257041 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-62cbb466-5897-445d-99f0-597dd22e9a49 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:20.258392 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-62cbb466-5897-445d-99f0-597dd22e9a49 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:20.261250 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-62cbb466-5897-445d-99f0-597dd22e9a49 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:20.568455 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-62cbb466-5897-445d-99f0-597dd22e9a49 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:20.584031 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-62cbb466-5897-445d-99f0-597dd22e9a49 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1507 microversion: 2.1 time: 0.373688 Dec 20 03:33:20.594242 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 315/640] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:20 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1507 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:20.633327 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b34d4104-21d6-4c9e-b8db-cadfe21384f8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:20.634440 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-b34d4104-21d6-4c9e-b8db-cadfe21384f8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:20.640744 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b34d4104-21d6-4c9e-b8db-cadfe21384f8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:20.641656 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b34d4104-21d6-4c9e-b8db-cadfe21384f8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:20.642830 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b34d4104-21d6-4c9e-b8db-cadfe21384f8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:20.643499 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b34d4104-21d6-4c9e-b8db-cadfe21384f8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:20.738164 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-16d863da-d76b-4c9c-b663-1712cd25cda7 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:20.738164 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-16d863da-d76b-4c9c-b663-1712cd25cda7 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:20.749965 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-16d863da-d76b-4c9c-b663-1712cd25cda7 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:20.750408 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-16d863da-d76b-4c9c-b663-1712cd25cda7 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:20.763727 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-16d863da-d76b-4c9c-b663-1712cd25cda7 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:20.784138 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-16d863da-d76b-4c9c-b663-1712cd25cda7 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:20.914683 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-16d863da-d76b-4c9c-b663-1712cd25cda7 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:20.923275 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-16d863da-d76b-4c9c-b663-1712cd25cda7 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282" status: 200 len: 1277 microversion: 2.1 time: 0.200258 Dec 20 03:33:20.933666 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 316/641] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:20 2021] GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282 => generated 1277 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:20.946043 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b34d4104-21d6-4c9e-b8db-cadfe21384f8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:20.958692 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b34d4104-21d6-4c9e-b8db-cadfe21384f8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1441 microversion: 2.1 time: 0.328887 Dec 20 03:33:20.973681 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 326/642] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:20 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1441 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:20.978347 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d3201b2a-15b5-4fa7-86d4-104857fadca6 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:20.979060 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d3201b2a-15b5-4fa7-86d4-104857fadca6 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:20.994525 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d3201b2a-15b5-4fa7-86d4-104857fadca6 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:20.994895 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d3201b2a-15b5-4fa7-86d4-104857fadca6 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:20.995708 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d3201b2a-15b5-4fa7-86d4-104857fadca6 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:20.996165 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d3201b2a-15b5-4fa7-86d4-104857fadca6 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:21.092315 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-36a10ccb-f2a7-4800-813c-348954d96a34 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:21.093036 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-36a10ccb-f2a7-4800-813c-348954d96a34 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:21.107343 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-36a10ccb-f2a7-4800-813c-348954d96a34 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:21.107880 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-36a10ccb-f2a7-4800-813c-348954d96a34 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:21.108834 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-36a10ccb-f2a7-4800-813c-348954d96a34 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:21.109410 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-36a10ccb-f2a7-4800-813c-348954d96a34 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:21.171996 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-36a10ccb-f2a7-4800-813c-348954d96a34 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:21.173001 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-36a10ccb-f2a7-4800-813c-348954d96a34 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:21.173619 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.objects.instance [None req-36a10ccb-f2a7-4800-813c-348954d96a34 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lazy-loading 'fault' on Instance uuid 5ec437d6-633a-468c-aa6a-d4c81df62919 {{(pid=117011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:33:21.234339 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d3201b2a-15b5-4fa7-86d4-104857fadca6 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:21.235757 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-36a10ccb-f2a7-4800-813c-348954d96a34 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:21.251580 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-36a10ccb-f2a7-4800-813c-348954d96a34 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 200 len: 1328 microversion: 2.1 time: 0.162601 Dec 20 03:33:21.251823 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d3201b2a-15b5-4fa7-86d4-104857fadca6 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1441 microversion: 2.1 time: 0.276301 Dec 20 03:33:21.253596 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 317/644] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:20 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1441 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:21.262310 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 327/644] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:21 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 1328 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:33:21.628324 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-b076f1c4-e274-4537-aef3-7312bf9a3a44 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:21.629533 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-b076f1c4-e274-4537-aef3-7312bf9a3a44 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:21.638738 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b076f1c4-e274-4537-aef3-7312bf9a3a44 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:21.639464 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b076f1c4-e274-4537-aef3-7312bf9a3a44 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:21.640533 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b076f1c4-e274-4537-aef3-7312bf9a3a44 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:21.641160 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b076f1c4-e274-4537-aef3-7312bf9a3a44 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:21.720050 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-b076f1c4-e274-4537-aef3-7312bf9a3a44 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:21.728342 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-b076f1c4-e274-4537-aef3-7312bf9a3a44 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1465 microversion: 2.1 time: 0.110707 Dec 20 03:33:21.738576 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 318/645] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:21 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1465 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:21.762334 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-c6c2a19f-9d4e-4f90-b2a7-53bb27bd6d44 req-11468aa7-94ba-4ec8-9fa6-6e491a200cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac8535fe-2f8e-4681-a5ba-7d6ee956b779", "name": "network-vif-deleted", "tag": "176ceebe-9cae-40dc-8342-df2cb17a5f92"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:21.764575 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:33:21.764575 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:33:21.778540 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-c6c2a19f-9d4e-4f90-b2a7-53bb27bd6d44 req-11468aa7-94ba-4ec8-9fa6-6e491a200cae service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:21.778994 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-c6c2a19f-9d4e-4f90-b2a7-53bb27bd6d44 req-11468aa7-94ba-4ec8-9fa6-6e491a200cae service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:21.819845 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-c6c2a19f-9d4e-4f90-b2a7-53bb27bd6d44 req-11468aa7-94ba-4ec8-9fa6-6e491a200cae service nova] Creating event network-vif-deleted:176ceebe-9cae-40dc-8342-df2cb17a5f92 for instance ac8535fe-2f8e-4681-a5ba-7d6ee956b779 on hv-cinder-81803 Dec 20 03:33:21.827512 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-c6c2a19f-9d4e-4f90-b2a7-53bb27bd6d44 req-11468aa7-94ba-4ec8-9fa6-6e491a200cae service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070484 Dec 20 03:33:21.828626 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 328/646] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:33:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:33:21.941580 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d30f4b9d-96fd-4eb9-a5bb-8c6d442dbef4 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:21.942588 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d30f4b9d-96fd-4eb9-a5bb-8c6d442dbef4 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:21.949216 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d30f4b9d-96fd-4eb9-a5bb-8c6d442dbef4 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:21.949970 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d30f4b9d-96fd-4eb9-a5bb-8c6d442dbef4 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:21.950776 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d30f4b9d-96fd-4eb9-a5bb-8c6d442dbef4 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:21.951225 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d30f4b9d-96fd-4eb9-a5bb-8c6d442dbef4 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:22.209017 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d30f4b9d-96fd-4eb9-a5bb-8c6d442dbef4 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:22.223016 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d30f4b9d-96fd-4eb9-a5bb-8c6d442dbef4 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282" status: 200 len: 1319 microversion: 2.1 time: 0.285125 Dec 20 03:33:22.224549 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 319/647] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:21 2021] GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:22.272871 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-5a71189e-e6c1-4642-aee5-cba48a1c3772 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:22.274160 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-5a71189e-e6c1-4642-aee5-cba48a1c3772 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:22.282279 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5a71189e-e6c1-4642-aee5-cba48a1c3772 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:22.283123 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5a71189e-e6c1-4642-aee5-cba48a1c3772 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:22.284190 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5a71189e-e6c1-4642-aee5-cba48a1c3772 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:22.284862 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5a71189e-e6c1-4642-aee5-cba48a1c3772 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:22.309393 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-5a71189e-e6c1-4642-aee5-cba48a1c3772 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] HTTP exception thrown: Instance 5ec437d6-633a-468c-aa6a-d4c81df62919 could not be found. Dec 20 03:33:22.309541 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-5a71189e-e6c1-4642-aee5-cba48a1c3772 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Returning 404 to user: Instance 5ec437d6-633a-468c-aa6a-d4c81df62919 could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:33:22.310485 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-5a71189e-e6c1-4642-aee5-cba48a1c3772 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 404 len: 111 microversion: 2.1 time: 0.043051 Dec 20 03:33:22.311058 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 329/648] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:22 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:33:22.320635 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c633261d-d659-49f8-8323-19b09a61cb82 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '.version_select at 0x7f490419b5e0>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:22.479730 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c633261d-d659-49f8-8323-19b09a61cb82 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1488803745" status: 202 len: 0 microversion: 2.1 time: 0.159690 Dec 20 03:33:22.480374 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 320/649] 10.222.0.53 () {58 vars in 1220 bytes} [Mon Dec 20 03:33:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1488803745 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 20 03:33:22.746595 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0317d98e-0feb-4837-8c1c-f217b975a68b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:22.747235 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-0317d98e-0feb-4837-8c1c-f217b975a68b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:22.755485 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0317d98e-0feb-4837-8c1c-f217b975a68b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:22.755940 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0317d98e-0feb-4837-8c1c-f217b975a68b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:22.756954 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0317d98e-0feb-4837-8c1c-f217b975a68b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:22.757591 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0317d98e-0feb-4837-8c1c-f217b975a68b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:22.796028 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0317d98e-0feb-4837-8c1c-f217b975a68b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:22.796744 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0317d98e-0feb-4837-8c1c-f217b975a68b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:22.797482 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.objects.instance [None req-0317d98e-0feb-4837-8c1c-f217b975a68b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lazy-loading 'fault' on Instance uuid ac8535fe-2f8e-4681-a5ba-7d6ee956b779 {{(pid=117011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:33:22.865408 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-0317d98e-0feb-4837-8c1c-f217b975a68b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:22.883234 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-0317d98e-0feb-4837-8c1c-f217b975a68b tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 200 len: 1311 microversion: 2.1 time: 0.140927 Dec 20 03:33:22.897250 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 330/650] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:22 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 1311 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:23.240430 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-055ef63c-90b9-4cdb-b031-a6c755e16d8e tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:23.241054 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-055ef63c-90b9-4cdb-b031-a6c755e16d8e tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:23.249774 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-055ef63c-90b9-4cdb-b031-a6c755e16d8e tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:23.250285 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-055ef63c-90b9-4cdb-b031-a6c755e16d8e tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:23.251025 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-055ef63c-90b9-4cdb-b031-a6c755e16d8e tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:23.251478 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-055ef63c-90b9-4cdb-b031-a6c755e16d8e tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:23.600699 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-055ef63c-90b9-4cdb-b031-a6c755e16d8e tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:23.613250 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-055ef63c-90b9-4cdb-b031-a6c755e16d8e tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282" status: 200 len: 1319 microversion: 2.1 time: 0.376923 Dec 20 03:33:23.614217 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 321/651] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:23 2021] GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282 => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:33:23.854417 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-e5b05670-a70f-4679-95dd-dc4f4347b02c req-22d558d3-4b28-450f-94f5-58bd7cc3d8cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aa45c54-d54d-4db6-b5b0-095ed9fbf282", "tag": "842047b2-0273-4a1a-b980-71e8c5a8478f"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:23.856066 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:33:23.856066 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:33:23.867168 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-e5b05670-a70f-4679-95dd-dc4f4347b02c req-22d558d3-4b28-450f-94f5-58bd7cc3d8cb service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:23.868970 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-e5b05670-a70f-4679-95dd-dc4f4347b02c req-22d558d3-4b28-450f-94f5-58bd7cc3d8cb service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:23.886922 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-e5b05670-a70f-4679-95dd-dc4f4347b02c req-22d558d3-4b28-450f-94f5-58bd7cc3d8cb service nova] Creating event network-changed:842047b2-0273-4a1a-b980-71e8c5a8478f for instance 9aa45c54-d54d-4db6-b5b0-095ed9fbf282 on hv-cinder-81803 Dec 20 03:33:23.891837 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-88716ffb-8e6a-4126-b35c-6c3ce886360a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'create', calling method: .version_select at 0x7f4904170ee0>, body: {"keypair": {"name": "tempest-keypair-385587714"}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:23.893101 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-e5b05670-a70f-4679-95dd-dc4f4347b02c req-22d558d3-4b28-450f-94f5-58bd7cc3d8cb service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045979 Dec 20 03:33:23.895011 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 331/652] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:33:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:33:23.904117 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0ea223ee-474a-45fd-9b7f-3fbbd053a209 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:23.905371 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-0ea223ee-474a-45fd-9b7f-3fbbd053a209 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: ac8535fe-2f8e-4681-a5ba-7d6ee956b779] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:23.912323 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-88716ffb-8e6a-4126-b35c-6c3ce886360a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Getting quotas for project f6cedc6984fc42c8a1f5b20ec5354095. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:33:23.912554 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0ea223ee-474a-45fd-9b7f-3fbbd053a209 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:23.912911 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0ea223ee-474a-45fd-9b7f-3fbbd053a209 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:23.913765 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0ea223ee-474a-45fd-9b7f-3fbbd053a209 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:23.914210 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0ea223ee-474a-45fd-9b7f-3fbbd053a209 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:23.917370 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-88716ffb-8e6a-4126-b35c-6c3ce886360a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Getting quotas for user 84bb957bae32453189561ef619aaf88e and project f6cedc6984fc42c8a1f5b20ec5354095. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:33:23.930616 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-0ea223ee-474a-45fd-9b7f-3fbbd053a209 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] HTTP exception thrown: Instance ac8535fe-2f8e-4681-a5ba-7d6ee956b779 could not be found. Dec 20 03:33:23.936813 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0ea223ee-474a-45fd-9b7f-3fbbd053a209 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Returning 404 to user: Instance ac8535fe-2f8e-4681-a5ba-7d6ee956b779 could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:33:23.936813 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-0ea223ee-474a-45fd-9b7f-3fbbd053a209 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779" status: 404 len: 111 microversion: 2.1 time: 0.034041 Dec 20 03:33:23.936813 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 332/653] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:23 2021] GET /compute/v2.1/servers/ac8535fe-2f8e-4681-a5ba-7d6ee956b779 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:33:23.940732 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-56c86ce6-b97c-4820-bf7c-9bdc6eb06334 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:23.941316 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-56c86ce6-b97c-4820-bf7c-9bdc6eb06334 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:23.948396 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-56c86ce6-b97c-4820-bf7c-9bdc6eb06334 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:23.948757 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-56c86ce6-b97c-4820-bf7c-9bdc6eb06334 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:23.949586 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-56c86ce6-b97c-4820-bf7c-9bdc6eb06334 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:23.950040 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-56c86ce6-b97c-4820-bf7c-9bdc6eb06334 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:23.987972 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-56c86ce6-b97c-4820-bf7c-9bdc6eb06334 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Going to try to terminate instance {{(pid=117011) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:33:24.213429 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-88716ffb-8e6a-4126-b35c-6c3ce886360a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Getting quotas for project f6cedc6984fc42c8a1f5b20ec5354095. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:33:24.217831 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-88716ffb-8e6a-4126-b35c-6c3ce886360a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Getting quotas for user 84bb957bae32453189561ef619aaf88e and project f6cedc6984fc42c8a1f5b20ec5354095. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:33:24.233328 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-88716ffb-8e6a-4126-b35c-6c3ce886360a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.345603 Dec 20 03:33:24.234550 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 322/654] 10.222.0.53 () {60 vars in 1157 bytes} [Mon Dec 20 03:33:23 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:33:24.327857 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-56c86ce6-b97c-4820-bf7c-9bdc6eb06334 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "DELETE /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 204 len: 0 microversion: 2.1 time: 0.390222 Dec 20 03:33:24.328679 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 333/655] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:33:23 2021] DELETE /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 20 03:33:24.338677 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-2ba4ac11-f250-4103-8e4e-5433b20db2dd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:24.338677 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-2ba4ac11-f250-4103-8e4e-5433b20db2dd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:24.351128 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2ba4ac11-f250-4103-8e4e-5433b20db2dd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:24.351676 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2ba4ac11-f250-4103-8e4e-5433b20db2dd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:24.352453 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2ba4ac11-f250-4103-8e4e-5433b20db2dd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:24.352889 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2ba4ac11-f250-4103-8e4e-5433b20db2dd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:24.637554 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-05834353-36c3-4a43-9676-444a40ed759b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:24.637554 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-05834353-36c3-4a43-9676-444a40ed759b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:24.648068 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-05834353-36c3-4a43-9676-444a40ed759b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:24.652269 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-05834353-36c3-4a43-9676-444a40ed759b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:24.652269 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-05834353-36c3-4a43-9676-444a40ed759b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:24.652269 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-05834353-36c3-4a43-9676-444a40ed759b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:24.689485 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-2ba4ac11-f250-4103-8e4e-5433b20db2dd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:24.702687 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-2ba4ac11-f250-4103-8e4e-5433b20db2dd tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.368422 Dec 20 03:33:24.704072 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 323/656] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:24 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:33:24.710583 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-3718a204-1bc4-4831-9b6f-20379a94b2a6 req-ca1609c6-ab21-4e44-9a4b-e320b562203b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc84db6-8d02-4fd4-b38c-c0a90f104993", "tag": "dcafb0f8-ea15-4cf6-ace1-0817393056e3"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:24.714501 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:33:24.714501 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:33:24.723512 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-3718a204-1bc4-4831-9b6f-20379a94b2a6 req-ca1609c6-ab21-4e44-9a4b-e320b562203b service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:24.726459 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-3718a204-1bc4-4831-9b6f-20379a94b2a6 req-ca1609c6-ab21-4e44-9a4b-e320b562203b service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:24.738116 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-3718a204-1bc4-4831-9b6f-20379a94b2a6 req-ca1609c6-ab21-4e44-9a4b-e320b562203b service nova] Creating event network-changed:dcafb0f8-ea15-4cf6-ace1-0817393056e3 for instance 3cc84db6-8d02-4fd4-b38c-c0a90f104993 on hv-cinder-81803 Dec 20 03:33:24.744049 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-3718a204-1bc4-4831-9b6f-20379a94b2a6 req-ca1609c6-ab21-4e44-9a4b-e320b562203b service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038409 Dec 20 03:33:24.744868 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 324/657] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:33:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:33:24.814296 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-05834353-36c3-4a43-9676-444a40ed759b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:24.830473 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-05834353-36c3-4a43-9676-444a40ed759b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282" status: 200 len: 1319 microversion: 2.1 time: 0.202213 Dec 20 03:33:24.830861 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 334/658] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:24 2021] GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:33:24.959878 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-4a48a565-f157-4417-a39f-5f8a6a62f307 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:24.960592 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-4a48a565-f157-4417-a39f-5f8a6a62f307 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:24.968253 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4a48a565-f157-4417-a39f-5f8a6a62f307 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:24.968707 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4a48a565-f157-4417-a39f-5f8a6a62f307 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:24.969548 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4a48a565-f157-4417-a39f-5f8a6a62f307 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:24.970184 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4a48a565-f157-4417-a39f-5f8a6a62f307 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:25.193642 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-4a48a565-f157-4417-a39f-5f8a6a62f307 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:25.212875 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-4a48a565-f157-4417-a39f-5f8a6a62f307 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1590 microversion: 2.1 time: 0.258222 Dec 20 03:33:25.213512 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 325/659] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:24 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1590 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:25.721562 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-7cbae8bd-19a6-427e-ae9f-5591d85d16d8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:25.723522 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-7cbae8bd-19a6-427e-ae9f-5591d85d16d8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:25.731174 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7cbae8bd-19a6-427e-ae9f-5591d85d16d8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:25.731890 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7cbae8bd-19a6-427e-ae9f-5591d85d16d8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:25.732874 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7cbae8bd-19a6-427e-ae9f-5591d85d16d8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:25.733516 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7cbae8bd-19a6-427e-ae9f-5591d85d16d8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:25.848595 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7330a075-a588-4ec7-a83d-985aee878746 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:25.849241 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-7330a075-a588-4ec7-a83d-985aee878746 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:25.857173 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7330a075-a588-4ec7-a83d-985aee878746 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:25.857614 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7330a075-a588-4ec7-a83d-985aee878746 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:25.858467 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7330a075-a588-4ec7-a83d-985aee878746 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:25.859076 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7330a075-a588-4ec7-a83d-985aee878746 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:25.985776 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-7cbae8bd-19a6-427e-ae9f-5591d85d16d8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:25.997270 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-7cbae8bd-19a6-427e-ae9f-5591d85d16d8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.280701 Dec 20 03:33:25.998185 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 335/660] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:25 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:26.012509 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7330a075-a588-4ec7-a83d-985aee878746 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:26.020011 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7330a075-a588-4ec7-a83d-985aee878746 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282" status: 200 len: 1319 microversion: 2.1 time: 0.176312 Dec 20 03:33:26.020827 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 326/661] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:25 2021] GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:33:27.015369 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-3434bc0f-d57f-47d9-afd9-68e05ea39d0e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:27.016141 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-3434bc0f-d57f-47d9-afd9-68e05ea39d0e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:27.023690 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3434bc0f-d57f-47d9-afd9-68e05ea39d0e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:27.024220 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3434bc0f-d57f-47d9-afd9-68e05ea39d0e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:27.025117 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3434bc0f-d57f-47d9-afd9-68e05ea39d0e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:27.027005 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3434bc0f-d57f-47d9-afd9-68e05ea39d0e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:27.039083 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-67298625-105f-449e-aa41-894995fdefd8 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:27.040465 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-67298625-105f-449e-aa41-894995fdefd8 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:27.048567 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-67298625-105f-449e-aa41-894995fdefd8 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:27.049191 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-67298625-105f-449e-aa41-894995fdefd8 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:27.051221 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-67298625-105f-449e-aa41-894995fdefd8 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:27.051962 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-67298625-105f-449e-aa41-894995fdefd8 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:27.211585 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-67298625-105f-449e-aa41-894995fdefd8 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:27.220789 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-67298625-105f-449e-aa41-894995fdefd8 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282" status: 200 len: 1319 microversion: 2.1 time: 0.187067 Dec 20 03:33:27.222856 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 327/662] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:27 2021] GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:27.259530 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-3434bc0f-d57f-47d9-afd9-68e05ea39d0e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:27.268380 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-3434bc0f-d57f-47d9-afd9-68e05ea39d0e tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.257601 Dec 20 03:33:27.268952 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 336/663] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:27 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:28.005599 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e7947b68-9041-4c5f-906a-87f7123e83df tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1458215183", "imageRef": "9c4ec443-915b-4997-82d3-08cc97ba635b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6092e9e-6552-44a6-a685-c033f6e4e6c9"}], "security_groups": [{"name": "tempest-securitygroup--1889091640"}], "key_name": "tempest-keypair-385587714", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:28.110786 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.network.neutron [None req-e7947b68-9041-4c5f-906a-87f7123e83df tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] validate_networks() for [('c6092e9e-6552-44a6-a685-c033f6e4e6c9', None, None, None, None, None)] {{(pid=117012) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:33:28.245272 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-5c163775-cf0b-41a4-a33f-eef98517ca83 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:28.246431 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-5c163775-cf0b-41a4-a33f-eef98517ca83 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:28.253555 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5c163775-cf0b-41a4-a33f-eef98517ca83 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:28.255295 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5c163775-cf0b-41a4-a33f-eef98517ca83 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:28.256231 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5c163775-cf0b-41a4-a33f-eef98517ca83 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:28.256670 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5c163775-cf0b-41a4-a33f-eef98517ca83 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:28.512442 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-5c163775-cf0b-41a4-a33f-eef98517ca83 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:28.520300 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-5c163775-cf0b-41a4-a33f-eef98517ca83 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282" status: 200 len: 1319 microversion: 2.1 time: 0.284407 Dec 20 03:33:28.520881 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 337/664] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:28 2021] GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282 => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:28.527081 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-3b4a8d1f-866b-43c0-9495-fa3d6e104851 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:28.527680 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-3b4a8d1f-866b-43c0-9495-fa3d6e104851 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:28.534006 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3b4a8d1f-866b-43c0-9495-fa3d6e104851 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:28.534667 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3b4a8d1f-866b-43c0-9495-fa3d6e104851 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:28.535830 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3b4a8d1f-866b-43c0-9495-fa3d6e104851 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:28.536429 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3b4a8d1f-866b-43c0-9495-fa3d6e104851 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:28.555211 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-e7947b68-9041-4c5f-906a-87f7123e83df tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Flavor limits 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:33:28.556293 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-e7947b68-9041-4c5f-906a-87f7123e83df tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Image limits 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:33:28.557169 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-e7947b68-9041-4c5f-906a-87f7123e83df tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Flavor pref 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:33:28.557879 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-e7947b68-9041-4c5f-906a-87f7123e83df tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Image pref 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:33:28.559081 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-e7947b68-9041-4c5f-906a-87f7123e83df tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:33:28.574822 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e7947b68-9041-4c5f-906a-87f7123e83df tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:28.582419 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e7947b68-9041-4c5f-906a-87f7123e83df tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:28.582419 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e7947b68-9041-4c5f-906a-87f7123e83df tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:28.582419 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e7947b68-9041-4c5f-906a-87f7123e83df tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:28.597224 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-e7947b68-9041-4c5f-906a-87f7123e83df tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Getting quotas for project f6cedc6984fc42c8a1f5b20ec5354095. Resources: {'instances', 'ram', 'cores'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:33:28.601803 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-e7947b68-9041-4c5f-906a-87f7123e83df tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Getting quotas for user 84bb957bae32453189561ef619aaf88e and project f6cedc6984fc42c8a1f5b20ec5354095. Resources: {'instances', 'ram', 'cores'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:33:28.614050 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e7947b68-9041-4c5f-906a-87f7123e83df tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Going to run 1 instances... {{(pid=117012) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:33:28.616511 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e7947b68-9041-4c5f-906a-87f7123e83df tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c4ec443-915b-4997-82d3-08cc97ba635b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117012) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:33:28.793700 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-3b4a8d1f-866b-43c0-9495-fa3d6e104851 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:28.799914 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-3b4a8d1f-866b-43c0-9495-fa3d6e104851 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.277981 Dec 20 03:33:28.801457 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 338/665] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:28 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:28.808994 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-dbc3b94b-ad0b-4d40-b680-0d8bfaae0e89 req-8e92444c-126f-4ce8-9226-b1ca271b88a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa45c54-d54d-4db6-b5b0-095ed9fbf282", "name": "network-vif-plugged", "status": "completed", "tag": "842047b2-0273-4a1a-b980-71e8c5a8478f"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:28.810963 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:33:28.810963 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:33:28.819221 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-dbc3b94b-ad0b-4d40-b680-0d8bfaae0e89 req-8e92444c-126f-4ce8-9226-b1ca271b88a2 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:28.819807 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-dbc3b94b-ad0b-4d40-b680-0d8bfaae0e89 req-8e92444c-126f-4ce8-9226-b1ca271b88a2 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:28.832598 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-dbc3b94b-ad0b-4d40-b680-0d8bfaae0e89 req-8e92444c-126f-4ce8-9226-b1ca271b88a2 service nova] Creating event network-vif-plugged:842047b2-0273-4a1a-b980-71e8c5a8478f for instance 9aa45c54-d54d-4db6-b5b0-095ed9fbf282 on hv-cinder-81803 Dec 20 03:33:28.845415 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-dbc3b94b-ad0b-4d40-b680-0d8bfaae0e89 req-8e92444c-126f-4ce8-9226-b1ca271b88a2 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036025 Dec 20 03:33:28.845415 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 339/666] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:33:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:33:28.845415 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-ad3b9fa5-1127-4206-85a2-e06bb71ca641 req-3aef1f89-6143-4f2b-abd7-483ed495f79c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2dfd907-6eb9-4420-b9dc-36fa0518d29a", "tag": "252e4b81-2b8b-4472-b0f9-0b2a9b974c88"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:28.847865 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:33:28.847865 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:33:28.854042 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-ad3b9fa5-1127-4206-85a2-e06bb71ca641 req-3aef1f89-6143-4f2b-abd7-483ed495f79c service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:28.854486 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-ad3b9fa5-1127-4206-85a2-e06bb71ca641 req-3aef1f89-6143-4f2b-abd7-483ed495f79c service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:28.866599 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-ad3b9fa5-1127-4206-85a2-e06bb71ca641 req-3aef1f89-6143-4f2b-abd7-483ed495f79c service nova] Creating event network-changed:252e4b81-2b8b-4472-b0f9-0b2a9b974c88 for instance d2dfd907-6eb9-4420-b9dc-36fa0518d29a on hv-cinder-81803 Dec 20 03:33:28.871941 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-ad3b9fa5-1127-4206-85a2-e06bb71ca641 req-3aef1f89-6143-4f2b-abd7-483ed495f79c service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031141 Dec 20 03:33:28.872937 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 340/667] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:33:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:33:28.912859 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e7947b68-9041-4c5f-906a-87f7123e83df tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.911832 Dec 20 03:33:28.918351 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 328/668] 10.222.0.53 () {60 vars in 1146 bytes} [Mon Dec 20 03:33:27 2021] POST /compute/v2.1/servers => generated 402 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 03:33:28.923740 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-eb08f4e9-4c29-4cd2-82ef-502b280edd45 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:28.924423 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-eb08f4e9-4c29-4cd2-82ef-502b280edd45 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:29.004161 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-eb08f4e9-4c29-4cd2-82ef-502b280edd45 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:29.015636 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-eb08f4e9-4c29-4cd2-82ef-502b280edd45 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 200 len: 1237 microversion: 2.1 time: 0.093045 Dec 20 03:33:29.021191 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 341/669] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:28 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 1237 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:29.546360 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-bf4d27c6-9ab5-4089-902f-032c8297c0c4 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:29.547195 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-bf4d27c6-9ab5-4089-902f-032c8297c0c4 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:29.555493 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bf4d27c6-9ab5-4089-902f-032c8297c0c4 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:29.556138 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bf4d27c6-9ab5-4089-902f-032c8297c0c4 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:29.557171 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bf4d27c6-9ab5-4089-902f-032c8297c0c4 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:29.557814 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bf4d27c6-9ab5-4089-902f-032c8297c0c4 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:29.723002 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-bf4d27c6-9ab5-4089-902f-032c8297c0c4 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:29.730774 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-bf4d27c6-9ab5-4089-902f-032c8297c0c4 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282" status: 200 len: 1319 microversion: 2.1 time: 0.188561 Dec 20 03:33:29.732450 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 329/670] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:29 2021] GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:29.827254 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ac865f33-022c-40d9-8cfe-80b5dac1e78a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:29.829515 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ac865f33-022c-40d9-8cfe-80b5dac1e78a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:29.851575 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ac865f33-022c-40d9-8cfe-80b5dac1e78a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:29.852466 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ac865f33-022c-40d9-8cfe-80b5dac1e78a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:29.854037 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ac865f33-022c-40d9-8cfe-80b5dac1e78a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:29.854735 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ac865f33-022c-40d9-8cfe-80b5dac1e78a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:30.036703 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-3facf57c-6ada-48b1-b756-fc7d799d159e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:30.037606 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-3facf57c-6ada-48b1-b756-fc7d799d159e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:30.057234 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ac865f33-022c-40d9-8cfe-80b5dac1e78a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:30.058860 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3facf57c-6ada-48b1-b756-fc7d799d159e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:30.059930 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3facf57c-6ada-48b1-b756-fc7d799d159e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:30.060947 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3facf57c-6ada-48b1-b756-fc7d799d159e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:30.061741 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3facf57c-6ada-48b1-b756-fc7d799d159e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:30.065930 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ac865f33-022c-40d9-8cfe-80b5dac1e78a tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.243117 Dec 20 03:33:30.077015 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 342/671] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:29 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:30.138945 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-3facf57c-6ada-48b1-b756-fc7d799d159e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:30.148004 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-3facf57c-6ada-48b1-b756-fc7d799d159e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 200 len: 1241 microversion: 2.1 time: 0.117881 Dec 20 03:33:30.148919 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 330/672] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:30 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 1241 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:30.751650 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-16d18e8a-48e4-49aa-9ffd-0b7beb923548 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:30.752272 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-16d18e8a-48e4-49aa-9ffd-0b7beb923548 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:30.758552 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-16d18e8a-48e4-49aa-9ffd-0b7beb923548 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:30.759000 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-16d18e8a-48e4-49aa-9ffd-0b7beb923548 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:30.759804 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-16d18e8a-48e4-49aa-9ffd-0b7beb923548 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:30.760240 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-16d18e8a-48e4-49aa-9ffd-0b7beb923548 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:30.918808 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-16d18e8a-48e4-49aa-9ffd-0b7beb923548 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:30.927799 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-16d18e8a-48e4-49aa-9ffd-0b7beb923548 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282" status: 200 len: 1319 microversion: 2.1 time: 0.183707 Dec 20 03:33:30.928390 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 343/673] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:30 2021] GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:31.084668 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-3f53c715-fec7-471c-b618-90470d8ec8de tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:31.085312 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-3f53c715-fec7-471c-b618-90470d8ec8de tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:31.091896 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3f53c715-fec7-471c-b618-90470d8ec8de tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:31.096300 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3f53c715-fec7-471c-b618-90470d8ec8de tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:31.096300 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3f53c715-fec7-471c-b618-90470d8ec8de tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:31.096300 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3f53c715-fec7-471c-b618-90470d8ec8de tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:31.165941 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-bc49f6a7-f2da-4f68-bcc5-8aefca25c712 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:31.166454 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-bc49f6a7-f2da-4f68-bcc5-8aefca25c712 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:31.172928 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bc49f6a7-f2da-4f68-bcc5-8aefca25c712 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:31.174121 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bc49f6a7-f2da-4f68-bcc5-8aefca25c712 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:31.174362 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bc49f6a7-f2da-4f68-bcc5-8aefca25c712 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:31.174638 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bc49f6a7-f2da-4f68-bcc5-8aefca25c712 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:31.252095 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-bc49f6a7-f2da-4f68-bcc5-8aefca25c712 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:31.261708 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-bc49f6a7-f2da-4f68-bcc5-8aefca25c712 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 200 len: 1289 microversion: 2.1 time: 0.100046 Dec 20 03:33:31.262510 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 344/674] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:31 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 1289 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:33:31.369887 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-3f53c715-fec7-471c-b618-90470d8ec8de tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:31.378339 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-3f53c715-fec7-471c-b618-90470d8ec8de tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1522 microversion: 2.1 time: 0.298064 Dec 20 03:33:31.379712 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 331/675] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:31 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:31.786290 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-d8c87504-2c1c-4114-8bb4-435675dac88c req-94996930-abb8-4acc-8d06-581415234e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e5cfe95-9804-4406-a893-82b021de3826", "name": "network-vif-deleted", "tag": "9885c0f5-72c6-4249-b8f6-5755a026febe"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:31.789852 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:33:31.789852 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:33:31.804552 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-d8c87504-2c1c-4114-8bb4-435675dac88c req-94996930-abb8-4acc-8d06-581415234e87 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:31.805126 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-d8c87504-2c1c-4114-8bb4-435675dac88c req-94996930-abb8-4acc-8d06-581415234e87 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:31.828157 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-d8c87504-2c1c-4114-8bb4-435675dac88c req-94996930-abb8-4acc-8d06-581415234e87 service nova] Creating event network-vif-deleted:9885c0f5-72c6-4249-b8f6-5755a026febe for instance 4e5cfe95-9804-4406-a893-82b021de3826 on hv-cinder-81803 Dec 20 03:33:31.838679 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-d8c87504-2c1c-4114-8bb4-435675dac88c req-94996930-abb8-4acc-8d06-581415234e87 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059747 Dec 20 03:33:31.839576 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 345/676] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:33:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:33:31.947108 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-8afd8807-23fa-4729-92b8-15d706a08377 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:31.948406 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-8afd8807-23fa-4729-92b8-15d706a08377 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:31.960478 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8afd8807-23fa-4729-92b8-15d706a08377 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:31.961510 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8afd8807-23fa-4729-92b8-15d706a08377 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:31.963588 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8afd8807-23fa-4729-92b8-15d706a08377 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:31.964703 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8afd8807-23fa-4729-92b8-15d706a08377 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:32.249731 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-8afd8807-23fa-4729-92b8-15d706a08377 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:32.258021 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-bfda3547-3762-4ac4-b861-7ab61d7c149b tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1528272423"}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:32.259456 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-bfda3547-3762-4ac4-b861-7ab61d7c149b tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:32.267155 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bfda3547-3762-4ac4-b861-7ab61d7c149b tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:32.267929 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bfda3547-3762-4ac4-b861-7ab61d7c149b tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:32.270520 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bfda3547-3762-4ac4-b861-7ab61d7c149b tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:32.271008 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bfda3547-3762-4ac4-b861-7ab61d7c149b tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:32.272249 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-8afd8807-23fa-4729-92b8-15d706a08377 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282" status: 200 len: 1508 microversion: 2.1 time: 0.331964 Dec 20 03:33:32.287096 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 332/677] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:31 2021] GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282 => generated 1508 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:32.292119 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c3413e86-10ca-4a53-940f-eeceddd1d634 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:32.292754 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c3413e86-10ca-4a53-940f-eeceddd1d634 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:32.310015 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c3413e86-10ca-4a53-940f-eeceddd1d634 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:32.310951 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c3413e86-10ca-4a53-940f-eeceddd1d634 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:32.312182 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c3413e86-10ca-4a53-940f-eeceddd1d634 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:32.312855 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c3413e86-10ca-4a53-940f-eeceddd1d634 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:32.438657 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c3413e86-10ca-4a53-940f-eeceddd1d634 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:32.447262 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c3413e86-10ca-4a53-940f-eeceddd1d634 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 200 len: 1295 microversion: 2.1 time: 0.158714 Dec 20 03:33:32.447856 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 333/678] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:32 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 1295 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:32.453535 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-9ef1dc8d-3a22-460a-87c5-c7d04e5fa67a tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fef44d2-3540-4725-bd2a-f319a8a97c18", "device": "/dev/sdb"}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:32.456585 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-9ef1dc8d-3a22-460a-87c5-c7d04e5fa67a tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:32.464959 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9ef1dc8d-3a22-460a-87c5-c7d04e5fa67a tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:32.465481 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9ef1dc8d-3a22-460a-87c5-c7d04e5fa67a tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:32.466773 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9ef1dc8d-3a22-460a-87c5-c7d04e5fa67a tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:32.467239 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9ef1dc8d-3a22-460a-87c5-c7d04e5fa67a tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:32.468133 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.network.security_group_api [None req-bfda3547-3762-4ac4-b861-7ab61d7c149b tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Adding security group 75465038-afa0-4bc4-8472-5ba4863afd0f to port 252e4b81-2b8b-4472-b0f9-0b2a9b974c88 Dec 20 03:33:32.977059 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-bfda3547-3762-4ac4-b861-7ab61d7c149b tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "POST /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a/action" status: 202 len: 0 microversion: 2.1 time: 0.725380 Dec 20 03:33:32.977919 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 346/679] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:33:32 2021] POST /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a/action => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:33:32.982653 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a098a83c-6539-4cfd-94da-231c32894e4c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:32.983516 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a098a83c-6539-4cfd-94da-231c32894e4c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:32.995661 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a098a83c-6539-4cfd-94da-231c32894e4c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:33.001992 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a098a83c-6539-4cfd-94da-231c32894e4c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:33.003080 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a098a83c-6539-4cfd-94da-231c32894e4c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:33.004333 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a098a83c-6539-4cfd-94da-231c32894e4c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:33.087597 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a098a83c-6539-4cfd-94da-231c32894e4c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:33.088342 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a098a83c-6539-4cfd-94da-231c32894e4c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:33.089007 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.objects.instance [None req-a098a83c-6539-4cfd-94da-231c32894e4c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lazy-loading 'fault' on Instance uuid 4e5cfe95-9804-4406-a893-82b021de3826 {{(pid=117011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:33:33.152569 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-a098a83c-6539-4cfd-94da-231c32894e4c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb4ec46c3a444d68005e0355a66775b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2685bc296a00477bb621dea25f74f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:33.167082 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a098a83c-6539-4cfd-94da-231c32894e4c tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 200 len: 1312 microversion: 2.1 time: 0.187352 Dec 20 03:33:33.167803 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 347/680] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:32 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 1312 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:33.175472 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-6ed8d811-f28c-4e02-9737-28e6d7eb7415 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:33.177834 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6ed8d811-f28c-4e02-9737-28e6d7eb7415 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:33.190616 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6ed8d811-f28c-4e02-9737-28e6d7eb7415 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:33.191568 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6ed8d811-f28c-4e02-9737-28e6d7eb7415 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:33.193593 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6ed8d811-f28c-4e02-9737-28e6d7eb7415 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:33.194808 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6ed8d811-f28c-4e02-9737-28e6d7eb7415 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:33.420053 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-9ef1dc8d-3a22-460a-87c5-c7d04e5fa67a tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "POST /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.968580 Dec 20 03:33:33.442257 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 334/681] 10.222.0.53 () {60 vars in 1322 bytes} [Mon Dec 20 03:33:32 2021] POST /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282/os-volume_attachments => generated 194 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:33:33.480364 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-258f5053-b25e-417d-9991-700a72555d3f req-fa1f02cf-6fc2-49fc-879d-3d058486312a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2dfd907-6eb9-4420-b9dc-36fa0518d29a", "tag": "252e4b81-2b8b-4472-b0f9-0b2a9b974c88"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:33.484616 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:33:33.484616 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:33:33.494039 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-258f5053-b25e-417d-9991-700a72555d3f req-fa1f02cf-6fc2-49fc-879d-3d058486312a service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:33.494781 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-258f5053-b25e-417d-9991-700a72555d3f req-fa1f02cf-6fc2-49fc-879d-3d058486312a service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:33.512668 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-258f5053-b25e-417d-9991-700a72555d3f req-fa1f02cf-6fc2-49fc-879d-3d058486312a service nova] Creating event network-changed:252e4b81-2b8b-4472-b0f9-0b2a9b974c88 for instance d2dfd907-6eb9-4420-b9dc-36fa0518d29a on hv-cinder-81803 Dec 20 03:33:33.519400 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-258f5053-b25e-417d-9991-700a72555d3f req-fa1f02cf-6fc2-49fc-879d-3d058486312a service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052274 Dec 20 03:33:33.520580 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 335/682] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:33:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:33:33.530982 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-97e85ce0-b1e7-438e-81d4-8a0b267e453a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:33.530982 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-97e85ce0-b1e7-438e-81d4-8a0b267e453a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:33.534829 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-97e85ce0-b1e7-438e-81d4-8a0b267e453a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:33.535678 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-97e85ce0-b1e7-438e-81d4-8a0b267e453a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:33.536907 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-97e85ce0-b1e7-438e-81d4-8a0b267e453a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:33.537621 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-97e85ce0-b1e7-438e-81d4-8a0b267e453a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:33.598000 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6ed8d811-f28c-4e02-9737-28e6d7eb7415 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:33.611752 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-6ed8d811-f28c-4e02-9737-28e6d7eb7415 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1756 microversion: 2.1 time: 0.442586 Dec 20 03:33:33.613002 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 348/683] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:33 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1756 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:34.056158 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-97e85ce0-b1e7-438e-81d4-8a0b267e453a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:34.063844 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-97e85ce0-b1e7-438e-81d4-8a0b267e453a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 200 len: 1363 microversion: 2.1 time: 0.541711 Dec 20 03:33:34.064623 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 336/684] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:33 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 1363 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:34.190799 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f045fb37-dda0-44de-9a64-1bc3373661d8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:34.192290 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-f045fb37-dda0-44de-9a64-1bc3373661d8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] [instance: 4e5cfe95-9804-4406-a893-82b021de3826] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:34.199512 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f045fb37-dda0-44de-9a64-1bc3373661d8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:34.199959 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f045fb37-dda0-44de-9a64-1bc3373661d8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:34.200850 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f045fb37-dda0-44de-9a64-1bc3373661d8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:34.201355 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f045fb37-dda0-44de-9a64-1bc3373661d8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:34.217682 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-f045fb37-dda0-44de-9a64-1bc3373661d8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] HTTP exception thrown: Instance 4e5cfe95-9804-4406-a893-82b021de3826 could not be found. Dec 20 03:33:34.218276 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f045fb37-dda0-44de-9a64-1bc3373661d8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] Returning 404 to user: Instance 4e5cfe95-9804-4406-a893-82b021de3826 could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:33:34.219103 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f045fb37-dda0-44de-9a64-1bc3373661d8 tempest-ServerRescueNegativeTestJSON-534165215 tempest-ServerRescueNegativeTestJSON-534165215-project] 10.222.0.53 "GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826" status: 404 len: 111 microversion: 2.1 time: 0.032254 Dec 20 03:33:34.219663 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 349/685] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:34 2021] GET /compute/v2.1/servers/4e5cfe95-9804-4406-a893-82b021de3826 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:33:34.448136 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-b02dee39-4ea1-427c-a5eb-62507e8d051a req-9c97de5a-d9fc-4f74-9143-f564c6b3ce29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d0ea081-3dd8-40ec-bade-7fbf12f68c75", "tag": "0937f7e3-7e3d-4d63-8a16-585915a1cb83"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:34.449851 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:33:34.449851 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:33:34.470964 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-b02dee39-4ea1-427c-a5eb-62507e8d051a req-9c97de5a-d9fc-4f74-9143-f564c6b3ce29 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:34.485767 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-b02dee39-4ea1-427c-a5eb-62507e8d051a req-9c97de5a-d9fc-4f74-9143-f564c6b3ce29 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:34.517020 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-b02dee39-4ea1-427c-a5eb-62507e8d051a req-9c97de5a-d9fc-4f74-9143-f564c6b3ce29 service nova] Creating event network-changed:0937f7e3-7e3d-4d63-8a16-585915a1cb83 for instance 4d0ea081-3dd8-40ec-bade-7fbf12f68c75 on hv-cinder-81803 Dec 20 03:33:34.534185 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-b02dee39-4ea1-427c-a5eb-62507e8d051a req-9c97de5a-d9fc-4f74-9143-f564c6b3ce29 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087034 Dec 20 03:33:34.536029 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 337/686] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:33:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:33:35.087949 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-2545c872-4510-4cb0-b49d-07b0e4ecb22f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:35.088691 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-2545c872-4510-4cb0-b49d-07b0e4ecb22f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:35.096386 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2545c872-4510-4cb0-b49d-07b0e4ecb22f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:35.097041 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2545c872-4510-4cb0-b49d-07b0e4ecb22f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:35.098501 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2545c872-4510-4cb0-b49d-07b0e4ecb22f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:35.098960 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2545c872-4510-4cb0-b49d-07b0e4ecb22f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:35.334526 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-2545c872-4510-4cb0-b49d-07b0e4ecb22f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:35.342515 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-2545c872-4510-4cb0-b49d-07b0e4ecb22f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 200 len: 1363 microversion: 2.1 time: 0.258631 Dec 20 03:33:35.343497 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 350/687] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:35 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:36.360144 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ec025eb3-831d-4074-b3cd-9d9fd18da49f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:36.361636 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ec025eb3-831d-4074-b3cd-9d9fd18da49f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:36.371894 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ec025eb3-831d-4074-b3cd-9d9fd18da49f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:36.373306 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ec025eb3-831d-4074-b3cd-9d9fd18da49f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:36.374589 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ec025eb3-831d-4074-b3cd-9d9fd18da49f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:36.375234 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ec025eb3-831d-4074-b3cd-9d9fd18da49f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:36.541348 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-ec025eb3-831d-4074-b3cd-9d9fd18da49f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:36.550097 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ec025eb3-831d-4074-b3cd-9d9fd18da49f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 200 len: 1363 microversion: 2.1 time: 0.194611 Dec 20 03:33:36.550845 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 338/688] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:36 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:37.567453 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d7bb6106-a43a-4675-8110-ffb0fc833c00 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:37.568221 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d7bb6106-a43a-4675-8110-ffb0fc833c00 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:37.574940 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d7bb6106-a43a-4675-8110-ffb0fc833c00 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:37.575537 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d7bb6106-a43a-4675-8110-ffb0fc833c00 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:37.582605 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d7bb6106-a43a-4675-8110-ffb0fc833c00 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:37.582605 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d7bb6106-a43a-4675-8110-ffb0fc833c00 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:37.716799 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d7bb6106-a43a-4675-8110-ffb0fc833c00 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:37.724709 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d7bb6106-a43a-4675-8110-ffb0fc833c00 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 200 len: 1363 microversion: 2.1 time: 0.161529 Dec 20 03:33:37.725301 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 351/689] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:37 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:38.746373 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-643c4561-1e3d-4d8f-bd0f-b3a1ba3bba34 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:38.747628 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-643c4561-1e3d-4d8f-bd0f-b3a1ba3bba34 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:38.754992 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-643c4561-1e3d-4d8f-bd0f-b3a1ba3bba34 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:38.755631 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-643c4561-1e3d-4d8f-bd0f-b3a1ba3bba34 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:38.756301 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-643c4561-1e3d-4d8f-bd0f-b3a1ba3bba34 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:38.756926 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-643c4561-1e3d-4d8f-bd0f-b3a1ba3bba34 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:38.903682 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-643c4561-1e3d-4d8f-bd0f-b3a1ba3bba34 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:38.911403 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-643c4561-1e3d-4d8f-bd0f-b3a1ba3bba34 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 200 len: 1363 microversion: 2.1 time: 0.173467 Dec 20 03:33:38.912008 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 339/690] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:38 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:39.928320 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-5144e483-dc11-4297-b44b-e7f4d5357886 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:39.928916 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-5144e483-dc11-4297-b44b-e7f4d5357886 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:39.937326 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5144e483-dc11-4297-b44b-e7f4d5357886 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:39.938019 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5144e483-dc11-4297-b44b-e7f4d5357886 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:39.939012 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5144e483-dc11-4297-b44b-e7f4d5357886 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:39.939877 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5144e483-dc11-4297-b44b-e7f4d5357886 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:40.112619 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-5144e483-dc11-4297-b44b-e7f4d5357886 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:40.121262 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-5144e483-dc11-4297-b44b-e7f4d5357886 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 200 len: 1363 microversion: 2.1 time: 0.197082 Dec 20 03:33:40.121868 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 352/691] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:39 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:40.794952 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-88954dec-21fa-4580-9318-7d4c835206ae req-9e709677-522c-4bc1-a0d4-c32d231ada5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d0ea081-3dd8-40ec-bade-7fbf12f68c75", "name": "network-vif-plugged", "status": "completed", "tag": "0937f7e3-7e3d-4d63-8a16-585915a1cb83"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:40.796545 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:33:40.796545 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:33:40.805347 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-88954dec-21fa-4580-9318-7d4c835206ae req-9e709677-522c-4bc1-a0d4-c32d231ada5e service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:40.805780 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-88954dec-21fa-4580-9318-7d4c835206ae req-9e709677-522c-4bc1-a0d4-c32d231ada5e service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:40.817490 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-88954dec-21fa-4580-9318-7d4c835206ae req-9e709677-522c-4bc1-a0d4-c32d231ada5e service nova] Creating event network-vif-plugged:0937f7e3-7e3d-4d63-8a16-585915a1cb83 for instance 4d0ea081-3dd8-40ec-bade-7fbf12f68c75 on hv-cinder-81803 Dec 20 03:33:40.822482 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-88954dec-21fa-4580-9318-7d4c835206ae req-9e709677-522c-4bc1-a0d4-c32d231ada5e service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031832 Dec 20 03:33:40.823081 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 340/692] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:33:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:33:41.138789 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-18fb5e56-a35b-4efd-b4c8-e933ee5cad1c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:41.140289 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-18fb5e56-a35b-4efd-b4c8-e933ee5cad1c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:41.148792 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-18fb5e56-a35b-4efd-b4c8-e933ee5cad1c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:41.149374 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-18fb5e56-a35b-4efd-b4c8-e933ee5cad1c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:41.150247 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-18fb5e56-a35b-4efd-b4c8-e933ee5cad1c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:41.151687 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-18fb5e56-a35b-4efd-b4c8-e933ee5cad1c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:41.408334 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-18fb5e56-a35b-4efd-b4c8-e933ee5cad1c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:41.416886 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-18fb5e56-a35b-4efd-b4c8-e933ee5cad1c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 200 len: 1363 microversion: 2.1 time: 0.282107 Dec 20 03:33:41.418038 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 353/693] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:41 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:42.438345 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ec2d023e-5818-433e-b548-93354867c419 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:42.439723 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ec2d023e-5818-433e-b548-93354867c419 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:42.454993 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ec2d023e-5818-433e-b548-93354867c419 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:42.455551 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ec2d023e-5818-433e-b548-93354867c419 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:42.457533 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ec2d023e-5818-433e-b548-93354867c419 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:42.457846 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ec2d023e-5818-433e-b548-93354867c419 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:42.732340 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-ec2d023e-5818-433e-b548-93354867c419 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:42.744665 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ec2d023e-5818-433e-b548-93354867c419 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 200 len: 1363 microversion: 2.1 time: 0.312997 Dec 20 03:33:42.745336 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 341/694] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:42 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:43.764072 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-aed3371e-4ac8-41da-b872-2604e74c8111 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:43.765484 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-aed3371e-4ac8-41da-b872-2604e74c8111 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:43.773645 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-aed3371e-4ac8-41da-b872-2604e74c8111 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:43.774099 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-aed3371e-4ac8-41da-b872-2604e74c8111 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:43.774895 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-aed3371e-4ac8-41da-b872-2604e74c8111 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:43.775341 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-aed3371e-4ac8-41da-b872-2604e74c8111 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:43.997531 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-aed3371e-4ac8-41da-b872-2604e74c8111 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:44.006248 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-aed3371e-4ac8-41da-b872-2604e74c8111 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 200 len: 1550 microversion: 2.1 time: 0.246002 Dec 20 03:33:44.007060 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 354/695] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:43 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 1550 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:44.024084 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-df0da5d7-ed88-4d85-bf02-bdff884f75a5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:44.024671 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-df0da5d7-ed88-4d85-bf02-bdff884f75a5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:44.031462 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-df0da5d7-ed88-4d85-bf02-bdff884f75a5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:44.031462 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-df0da5d7-ed88-4d85-bf02-bdff884f75a5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:44.032192 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-df0da5d7-ed88-4d85-bf02-bdff884f75a5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:44.032640 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-df0da5d7-ed88-4d85-bf02-bdff884f75a5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:44.121360 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-df0da5d7-ed88-4d85-bf02-bdff884f75a5 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102483 Dec 20 03:33:44.121953 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 342/696] 10.222.0.53 () {58 vars in 1274 bytes} [Mon Dec 20 03:33:44 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:33:45.865468 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-18783ebf-4002-46c4-913d-06fc1dcec923 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:45.866600 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-18783ebf-4002-46c4-913d-06fc1dcec923 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:45.876727 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-18783ebf-4002-46c4-913d-06fc1dcec923 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:45.877566 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-18783ebf-4002-46c4-913d-06fc1dcec923 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:45.880106 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-18783ebf-4002-46c4-913d-06fc1dcec923 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:45.880574 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-647080b6-dd06-44dd-8b0c-31c0bd9f7127 req-831ff19f-db47-4d84-9494-356699efd982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d0ea081-3dd8-40ec-bade-7fbf12f68c75", "tag": "0937f7e3-7e3d-4d63-8a16-585915a1cb83"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:45.881313 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-18783ebf-4002-46c4-913d-06fc1dcec923 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:45.882385 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:33:45.882385 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:33:45.902513 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-647080b6-dd06-44dd-8b0c-31c0bd9f7127 req-831ff19f-db47-4d84-9494-356699efd982 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:45.903058 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-647080b6-dd06-44dd-8b0c-31c0bd9f7127 req-831ff19f-db47-4d84-9494-356699efd982 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:45.915747 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-647080b6-dd06-44dd-8b0c-31c0bd9f7127 req-831ff19f-db47-4d84-9494-356699efd982 service nova] Creating event network-changed:0937f7e3-7e3d-4d63-8a16-585915a1cb83 for instance 4d0ea081-3dd8-40ec-bade-7fbf12f68c75 on hv-cinder-81803 Dec 20 03:33:45.921763 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-647080b6-dd06-44dd-8b0c-31c0bd9f7127 req-831ff19f-db47-4d84-9494-356699efd982 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046649 Dec 20 03:33:45.923132 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 343/697] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:33:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:33:46.110180 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a83f09f6-bd55-4356-8bb0-481319d041b9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'create', calling method: .version_select at 0x7f490415fe50>, body: {"keypair": {"name": "tempest-keypair-1964014662"}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:46.131377 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-18783ebf-4002-46c4-913d-06fc1dcec923 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 14 microversion: 2.1 time: 0.269673 Dec 20 03:33:46.132395 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-a83f09f6-bd55-4356-8bb0-481319d041b9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Getting quotas for project b0a8965a4b4645829a64cb1f5aec4f44. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:33:46.135972 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 355/698] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:33:45 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 14 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 03:33:46.140111 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-a83f09f6-bd55-4356-8bb0-481319d041b9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Getting quotas for user 8cedc29bf2c8490db1977aa5613380d7 and project b0a8965a4b4645829a64cb1f5aec4f44. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:33:46.422468 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-a83f09f6-bd55-4356-8bb0-481319d041b9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Getting quotas for project b0a8965a4b4645829a64cb1f5aec4f44. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:33:46.430094 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-a83f09f6-bd55-4356-8bb0-481319d041b9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Getting quotas for user 8cedc29bf2c8490db1977aa5613380d7 and project b0a8965a4b4645829a64cb1f5aec4f44. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:33:46.479755 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a83f09f6-bd55-4356-8bb0-481319d041b9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.555059 Dec 20 03:33:46.481039 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 344/699] 10.222.0.53 () {62 vars in 1198 bytes} [Mon Dec 20 03:33:45 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 557 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 20 03:33:47.145604 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1e6d79f6-0093-49b8-ba03-dc471704e434 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:47.146790 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1e6d79f6-0093-49b8-ba03-dc471704e434 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:47.155172 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1e6d79f6-0093-49b8-ba03-dc471704e434 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:47.158599 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1e6d79f6-0093-49b8-ba03-dc471704e434 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:47.161396 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1e6d79f6-0093-49b8-ba03-dc471704e434 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:47.162434 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1e6d79f6-0093-49b8-ba03-dc471704e434 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:47.265244 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1e6d79f6-0093-49b8-ba03-dc471704e434 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 14 microversion: 2.1 time: 0.124686 Dec 20 03:33:47.266313 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 356/700] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:33:47 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 03:33:48.278074 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-6d788f0b-bffd-46d6-af88-18715a96e5db tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:48.280135 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6d788f0b-bffd-46d6-af88-18715a96e5db tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:48.288319 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6d788f0b-bffd-46d6-af88-18715a96e5db tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:48.288656 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6d788f0b-bffd-46d6-af88-18715a96e5db tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:48.289633 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6d788f0b-bffd-46d6-af88-18715a96e5db tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:48.290191 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6d788f0b-bffd-46d6-af88-18715a96e5db tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:49.249490 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-fd295d17-a784-4e00-b56f-53bdf43c8f64 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-399337305", "imageRef": "9c4ec443-915b-4997-82d3-08cc97ba635b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99da0c44-2558-4512-bf74-f9aa04dfdd38"}], "security_groups": [{"name": "tempest-securitygroup--540481892"}], "key_name": "tempest-keypair-1964014662", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:49.370035 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.network.neutron [None req-fd295d17-a784-4e00-b56f-53bdf43c8f64 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] validate_networks() for [('99da0c44-2558-4512-bf74-f9aa04dfdd38', None, None, None, None, None)] {{(pid=117011) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:33:49.853405 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-fd295d17-a784-4e00-b56f-53bdf43c8f64 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Flavor limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:33:49.854113 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-fd295d17-a784-4e00-b56f-53bdf43c8f64 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Image limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:33:49.854944 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-fd295d17-a784-4e00-b56f-53bdf43c8f64 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Flavor pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:33:49.855694 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-fd295d17-a784-4e00-b56f-53bdf43c8f64 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Image pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:33:49.856509 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-fd295d17-a784-4e00-b56f-53bdf43c8f64 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:33:49.870114 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fd295d17-a784-4e00-b56f-53bdf43c8f64 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:49.870559 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fd295d17-a784-4e00-b56f-53bdf43c8f64 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:49.871392 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fd295d17-a784-4e00-b56f-53bdf43c8f64 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:49.871824 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fd295d17-a784-4e00-b56f-53bdf43c8f64 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:49.889886 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-fd295d17-a784-4e00-b56f-53bdf43c8f64 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Getting quotas for project b0a8965a4b4645829a64cb1f5aec4f44. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:33:49.893854 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-fd295d17-a784-4e00-b56f-53bdf43c8f64 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Getting quotas for user 8cedc29bf2c8490db1977aa5613380d7 and project b0a8965a4b4645829a64cb1f5aec4f44. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:33:49.905952 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-fd295d17-a784-4e00-b56f-53bdf43c8f64 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Going to run 1 instances... {{(pid=117011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:33:49.908378 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-fd295d17-a784-4e00-b56f-53bdf43c8f64 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c4ec443-915b-4997-82d3-08cc97ba635b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:33:50.125243 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-fd295d17-a784-4e00-b56f-53bdf43c8f64 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.880598 Dec 20 03:33:50.125884 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 357/701] 10.222.0.53 () {62 vars in 1187 bytes} [Mon Dec 20 03:33:49 2021] POST /compute/v2.1/servers => generated 401 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 20 03:33:50.136066 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-36cd48cf-ed90-4918-b091-e914d65205de tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:50.136684 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-36cd48cf-ed90-4918-b091-e914d65205de tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:50.196742 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-36cd48cf-ed90-4918-b091-e914d65205de tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:50.203678 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-36cd48cf-ed90-4918-b091-e914d65205de tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:50.205235 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-36cd48cf-ed90-4918-b091-e914d65205de tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:50.206303 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-36cd48cf-ed90-4918-b091-e914d65205de tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1281 microversion: 2.20 time: 0.074213 Dec 20 03:33:50.206853 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 358/702] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:33:50 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:33:50.791699 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-6d788f0b-bffd-46d6-af88-18715a96e5db tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 14 microversion: 2.1 time: 2.517922 Dec 20 03:33:50.792366 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 345/703] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:33:48 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 14 bytes in 2519 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 03:33:51.225818 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-917ee315-2917-4398-a9cf-89a808a97300 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:51.226529 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-917ee315-2917-4398-a9cf-89a808a97300 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:51.282830 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-917ee315-2917-4398-a9cf-89a808a97300 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:51.291445 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-917ee315-2917-4398-a9cf-89a808a97300 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:51.293068 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-917ee315-2917-4398-a9cf-89a808a97300 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:51.294221 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-917ee315-2917-4398-a9cf-89a808a97300 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1281 microversion: 2.20 time: 0.073077 Dec 20 03:33:51.300372 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 359/704] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:33:51 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:33:51.803249 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-47e6a993-994e-414e-8b57-3f5a1e3f0fab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:51.804826 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-47e6a993-994e-414e-8b57-3f5a1e3f0fab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:51.811928 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-47e6a993-994e-414e-8b57-3f5a1e3f0fab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:51.812375 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-47e6a993-994e-414e-8b57-3f5a1e3f0fab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:51.813246 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-47e6a993-994e-414e-8b57-3f5a1e3f0fab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:51.813620 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-47e6a993-994e-414e-8b57-3f5a1e3f0fab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:51.924796 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-47e6a993-994e-414e-8b57-3f5a1e3f0fab tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 14 microversion: 2.1 time: 0.125391 Dec 20 03:33:51.925639 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 346/705] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:33:51 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 20 03:33:52.316993 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a1ac56cb-d22e-4879-8ef7-861f7702eb31 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:52.317738 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a1ac56cb-d22e-4879-8ef7-861f7702eb31 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:52.325369 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a1ac56cb-d22e-4879-8ef7-861f7702eb31 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:52.325824 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a1ac56cb-d22e-4879-8ef7-861f7702eb31 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:52.326612 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a1ac56cb-d22e-4879-8ef7-861f7702eb31 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:52.327049 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a1ac56cb-d22e-4879-8ef7-861f7702eb31 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:52.404830 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-a1ac56cb-d22e-4879-8ef7-861f7702eb31 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:52.412898 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-a1ac56cb-d22e-4879-8ef7-861f7702eb31 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:52.414533 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-a1ac56cb-d22e-4879-8ef7-861f7702eb31 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:52.415631 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a1ac56cb-d22e-4879-8ef7-861f7702eb31 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1333 microversion: 2.20 time: 0.102625 Dec 20 03:33:52.416219 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 360/706] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:33:52 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1333 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:33:52.936875 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-6e191558-9d6f-405c-83da-905c6de1275a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:52.938050 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6e191558-9d6f-405c-83da-905c6de1275a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:52.945435 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6e191558-9d6f-405c-83da-905c6de1275a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:52.945949 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6e191558-9d6f-405c-83da-905c6de1275a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:52.947160 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6e191558-9d6f-405c-83da-905c6de1275a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:52.947605 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6e191558-9d6f-405c-83da-905c6de1275a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:53.070238 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-6e191558-9d6f-405c-83da-905c6de1275a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 14 microversion: 2.1 time: 0.137173 Dec 20 03:33:53.074141 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 347/707] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:33:52 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 03:33:53.434620 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b5ae4572-61a9-4d07-92e0-3da609c220e6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:53.435325 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-b5ae4572-61a9-4d07-92e0-3da609c220e6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:53.441748 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b5ae4572-61a9-4d07-92e0-3da609c220e6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:53.446593 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b5ae4572-61a9-4d07-92e0-3da609c220e6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:53.446593 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b5ae4572-61a9-4d07-92e0-3da609c220e6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:53.446593 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b5ae4572-61a9-4d07-92e0-3da609c220e6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:53.505504 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b5ae4572-61a9-4d07-92e0-3da609c220e6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:53.513730 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b5ae4572-61a9-4d07-92e0-3da609c220e6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:53.515219 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b5ae4572-61a9-4d07-92e0-3da609c220e6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:53.516321 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b5ae4572-61a9-4d07-92e0-3da609c220e6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1339 microversion: 2.20 time: 0.086745 Dec 20 03:33:53.516879 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 361/708] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:33:53 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1339 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:33:54.084822 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c17d3b0e-91cf-4233-a1b0-20dd3ec6214b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:54.085867 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c17d3b0e-91cf-4233-a1b0-20dd3ec6214b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:54.093627 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c17d3b0e-91cf-4233-a1b0-20dd3ec6214b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:54.094079 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c17d3b0e-91cf-4233-a1b0-20dd3ec6214b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:54.094875 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c17d3b0e-91cf-4233-a1b0-20dd3ec6214b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:54.095305 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c17d3b0e-91cf-4233-a1b0-20dd3ec6214b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:54.195666 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c17d3b0e-91cf-4233-a1b0-20dd3ec6214b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 14 microversion: 2.1 time: 0.115062 Dec 20 03:33:54.197508 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 348/709] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:33:54 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 03:33:54.535393 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-7406d989-6a68-43f8-ab7a-c406a5215566 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:54.536122 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-7406d989-6a68-43f8-ab7a-c406a5215566 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:54.543119 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7406d989-6a68-43f8-ab7a-c406a5215566 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:54.543857 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7406d989-6a68-43f8-ab7a-c406a5215566 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:54.544844 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7406d989-6a68-43f8-ab7a-c406a5215566 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:54.545822 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7406d989-6a68-43f8-ab7a-c406a5215566 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:54.688604 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-aa86d1de-eef9-46ac-a05e-f7755816bf41 req-89d4fdb8-1a0e-4c8f-a331-29568d76a711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a1645c1-a90b-406b-ba58-0620598ecf89", "tag": "31810791-54e6-413e-889b-510ef52f5b14"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:54.690431 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:33:54.690431 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:33:54.701833 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-7406d989-6a68-43f8-ab7a-c406a5215566 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:54.702103 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-aa86d1de-eef9-46ac-a05e-f7755816bf41 req-89d4fdb8-1a0e-4c8f-a331-29568d76a711 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:54.702245 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-aa86d1de-eef9-46ac-a05e-f7755816bf41 req-89d4fdb8-1a0e-4c8f-a331-29568d76a711 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:54.714183 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-7406d989-6a68-43f8-ab7a-c406a5215566 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:54.722055 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-aa86d1de-eef9-46ac-a05e-f7755816bf41 req-89d4fdb8-1a0e-4c8f-a331-29568d76a711 service nova] Creating event network-changed:31810791-54e6-413e-889b-510ef52f5b14 for instance 4a1645c1-a90b-406b-ba58-0620598ecf89 on hv-cinder-81803 Dec 20 03:33:54.723697 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-7406d989-6a68-43f8-ab7a-c406a5215566 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:54.725160 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-7406d989-6a68-43f8-ab7a-c406a5215566 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1406 microversion: 2.20 time: 0.193514 Dec 20 03:33:54.726196 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 362/710] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:33:54 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:33:54.731243 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-aa86d1de-eef9-46ac-a05e-f7755816bf41 req-89d4fdb8-1a0e-4c8f-a331-29568d76a711 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054354 Dec 20 03:33:54.731854 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 349/711] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:33:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:33:54.824248 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-8341055f-f759-456a-b3ee-95bec9631a5d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:54.824848 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-8341055f-f759-456a-b3ee-95bec9631a5d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:54.832410 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8341055f-f759-456a-b3ee-95bec9631a5d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:54.833288 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8341055f-f759-456a-b3ee-95bec9631a5d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:54.840216 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8341055f-f759-456a-b3ee-95bec9631a5d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:54.840759 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8341055f-f759-456a-b3ee-95bec9631a5d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:54.942541 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.objects.instance [None req-8341055f-f759-456a-b3ee-95bec9631a5d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lazy-loading 'services' on Instance uuid 9aa45c54-d54d-4db6-b5b0-095ed9fbf282 {{(pid=117011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:33:55.168288 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-8341055f-f759-456a-b3ee-95bec9631a5d tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "DELETE /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282/os-volume_attachments/1fef44d2-3540-4725-bd2a-f319a8a97c18" status: 202 len: 0 microversion: 2.1 time: 0.348152 Dec 20 03:33:55.169632 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 363/712] 10.222.0.53 () {58 vars in 1415 bytes} [Mon Dec 20 03:33:54 2021] DELETE /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282/os-volume_attachments/1fef44d2-3540-4725-bd2a-f319a8a97c18 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:33:55.215347 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-8cef6ea3-cf8f-419f-93c1-a6fecd3e7d50 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:55.216209 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-8cef6ea3-cf8f-419f-93c1-a6fecd3e7d50 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:55.223978 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8cef6ea3-cf8f-419f-93c1-a6fecd3e7d50 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:55.224436 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8cef6ea3-cf8f-419f-93c1-a6fecd3e7d50 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:55.225265 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8cef6ea3-cf8f-419f-93c1-a6fecd3e7d50 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:55.225739 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8cef6ea3-cf8f-419f-93c1-a6fecd3e7d50 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:55.349458 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-8cef6ea3-cf8f-419f-93c1-a6fecd3e7d50 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 14 microversion: 2.1 time: 0.141989 Dec 20 03:33:55.351542 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 350/713] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:33:55 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 03:33:55.745175 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-32abc7e6-cbe1-4cc7-a1e2-29cfeba4ee7d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:55.745933 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-32abc7e6-cbe1-4cc7-a1e2-29cfeba4ee7d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:55.752679 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-32abc7e6-cbe1-4cc7-a1e2-29cfeba4ee7d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:55.753129 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-32abc7e6-cbe1-4cc7-a1e2-29cfeba4ee7d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:55.762176 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-32abc7e6-cbe1-4cc7-a1e2-29cfeba4ee7d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:55.762176 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-32abc7e6-cbe1-4cc7-a1e2-29cfeba4ee7d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:55.898721 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-32abc7e6-cbe1-4cc7-a1e2-29cfeba4ee7d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:55.908001 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-32abc7e6-cbe1-4cc7-a1e2-29cfeba4ee7d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:55.909492 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-32abc7e6-cbe1-4cc7-a1e2-29cfeba4ee7d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:55.910593 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-32abc7e6-cbe1-4cc7-a1e2-29cfeba4ee7d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1406 microversion: 2.20 time: 0.170273 Dec 20 03:33:55.911151 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 364/714] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:33:55 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:33:56.366163 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e75c6799-7894-4111-a4e5-e1c3f1a4cb4c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:56.366163 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e75c6799-7894-4111-a4e5-e1c3f1a4cb4c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:56.373719 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e75c6799-7894-4111-a4e5-e1c3f1a4cb4c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:56.374172 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e75c6799-7894-4111-a4e5-e1c3f1a4cb4c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:56.374970 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e75c6799-7894-4111-a4e5-e1c3f1a4cb4c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:56.375532 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e75c6799-7894-4111-a4e5-e1c3f1a4cb4c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:56.512099 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e75c6799-7894-4111-a4e5-e1c3f1a4cb4c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 14 microversion: 2.1 time: 0.154473 Dec 20 03:33:56.512741 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 351/715] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:33:56 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 20 03:33:56.928070 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-06867a3b-887b-488e-828b-fa441eecb8d3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:56.928674 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-06867a3b-887b-488e-828b-fa441eecb8d3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:56.935227 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-06867a3b-887b-488e-828b-fa441eecb8d3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:56.935688 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-06867a3b-887b-488e-828b-fa441eecb8d3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:56.936484 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-06867a3b-887b-488e-828b-fa441eecb8d3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:56.936920 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-06867a3b-887b-488e-828b-fa441eecb8d3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:57.072007 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-06867a3b-887b-488e-828b-fa441eecb8d3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:57.080231 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-06867a3b-887b-488e-828b-fa441eecb8d3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:57.081740 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-06867a3b-887b-488e-828b-fa441eecb8d3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:57.082828 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-06867a3b-887b-488e-828b-fa441eecb8d3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1406 microversion: 2.20 time: 0.158482 Dec 20 03:33:57.083384 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 365/716] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:33:56 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:33:57.352803 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-3ea708ab-62fb-403d-90ce-30139752fbab tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:57.353427 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-3ea708ab-62fb-403d-90ce-30139752fbab tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:57.360680 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3ea708ab-62fb-403d-90ce-30139752fbab tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:57.361251 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3ea708ab-62fb-403d-90ce-30139752fbab tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:57.362064 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3ea708ab-62fb-403d-90ce-30139752fbab tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:57.362506 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3ea708ab-62fb-403d-90ce-30139752fbab tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:57.390299 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-3ea708ab-62fb-403d-90ce-30139752fbab tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Going to try to terminate instance {{(pid=117012) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:33:57.524543 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-aed40ece-7cae-4f82-bf3c-ac2eced65421 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:57.525568 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-aed40ece-7cae-4f82-bf3c-ac2eced65421 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:57.531548 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-aed40ece-7cae-4f82-bf3c-ac2eced65421 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:57.531991 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-aed40ece-7cae-4f82-bf3c-ac2eced65421 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:57.532788 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-aed40ece-7cae-4f82-bf3c-ac2eced65421 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:57.533211 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-aed40ece-7cae-4f82-bf3c-ac2eced65421 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:57.631356 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-aed40ece-7cae-4f82-bf3c-ac2eced65421 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 14 microversion: 2.1 time: 0.111019 Dec 20 03:33:57.631985 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 366/717] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:33:57 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 20 03:33:57.755696 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-3ea708ab-62fb-403d-90ce-30139752fbab tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "DELETE /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282" status: 204 len: 0 microversion: 2.1 time: 0.406765 Dec 20 03:33:57.756284 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 352/718] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:33:57 2021] DELETE /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:33:57.765593 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-717f2505-465a-4317-9579-b19b8d4e3f7c tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:57.766299 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-717f2505-465a-4317-9579-b19b8d4e3f7c tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:57.773166 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-717f2505-465a-4317-9579-b19b8d4e3f7c tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:57.773642 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-717f2505-465a-4317-9579-b19b8d4e3f7c tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:57.775158 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-717f2505-465a-4317-9579-b19b8d4e3f7c tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:57.775603 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-717f2505-465a-4317-9579-b19b8d4e3f7c tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:57.906841 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-717f2505-465a-4317-9579-b19b8d4e3f7c tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:57.914819 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-717f2505-465a-4317-9579-b19b8d4e3f7c tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282" status: 200 len: 1514 microversion: 2.1 time: 0.153550 Dec 20 03:33:57.915379 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 367/719] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:57 2021] GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:58.101481 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-519a71f2-4241-463e-bf30-b69df86cf932 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:58.102495 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-519a71f2-4241-463e-bf30-b69df86cf932 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:58.109591 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-519a71f2-4241-463e-bf30-b69df86cf932 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:58.110037 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-519a71f2-4241-463e-bf30-b69df86cf932 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:58.110801 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-519a71f2-4241-463e-bf30-b69df86cf932 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:58.111233 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-519a71f2-4241-463e-bf30-b69df86cf932 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:58.244733 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-519a71f2-4241-463e-bf30-b69df86cf932 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:58.252744 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-519a71f2-4241-463e-bf30-b69df86cf932 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:58.254288 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-519a71f2-4241-463e-bf30-b69df86cf932 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:58.255410 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-519a71f2-4241-463e-bf30-b69df86cf932 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1406 microversion: 2.20 time: 0.158047 Dec 20 03:33:58.255965 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 353/720] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:33:58 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:33:58.642449 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-09b10df5-d7c5-4195-8ce7-6ebf33e9bdf4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:58.643422 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-09b10df5-d7c5-4195-8ce7-6ebf33e9bdf4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:58.650416 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-09b10df5-d7c5-4195-8ce7-6ebf33e9bdf4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:58.652566 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-09b10df5-d7c5-4195-8ce7-6ebf33e9bdf4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:58.652566 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-09b10df5-d7c5-4195-8ce7-6ebf33e9bdf4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:58.652566 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-09b10df5-d7c5-4195-8ce7-6ebf33e9bdf4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:58.765060 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-09b10df5-d7c5-4195-8ce7-6ebf33e9bdf4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 6835 microversion: 2.1 time: 0.126619 Dec 20 03:33:58.768628 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 368/721] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:33:58 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 6835 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:58.932807 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e6838eec-3bf8-4fdb-a8cd-d77085c3d3ab tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:58.933407 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e6838eec-3bf8-4fdb-a8cd-d77085c3d3ab tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:58.939931 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e6838eec-3bf8-4fdb-a8cd-d77085c3d3ab tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:58.940379 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e6838eec-3bf8-4fdb-a8cd-d77085c3d3ab tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:58.941194 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e6838eec-3bf8-4fdb-a8cd-d77085c3d3ab tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:58.941686 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e6838eec-3bf8-4fdb-a8cd-d77085c3d3ab tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:59.074262 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-e6838eec-3bf8-4fdb-a8cd-d77085c3d3ab tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:59.081585 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e6838eec-3bf8-4fdb-a8cd-d77085c3d3ab tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282" status: 200 len: 1514 microversion: 2.1 time: 0.153498 Dec 20 03:33:59.082158 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 354/722] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:33:58 2021] GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:33:59.274366 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f23ef3c5-47d6-441a-bac7-a3431560a83a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:33:59.275139 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-f23ef3c5-47d6-441a-bac7-a3431560a83a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:59.282361 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f23ef3c5-47d6-441a-bac7-a3431560a83a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:59.282811 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f23ef3c5-47d6-441a-bac7-a3431560a83a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:59.283589 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f23ef3c5-47d6-441a-bac7-a3431560a83a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:59.284028 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f23ef3c5-47d6-441a-bac7-a3431560a83a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:59.418306 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-f23ef3c5-47d6-441a-bac7-a3431560a83a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:59.426226 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-f23ef3c5-47d6-441a-bac7-a3431560a83a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:59.427803 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-f23ef3c5-47d6-441a-bac7-a3431560a83a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:33:59.428883 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f23ef3c5-47d6-441a-bac7-a3431560a83a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1406 microversion: 2.20 time: 0.158569 Dec 20 03:33:59.429478 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 369/723] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:33:59 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:33:59.776613 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ac8689b7-ce60-4eb2-bc77-feddcd4b6933 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:33:59.777523 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ac8689b7-ce60-4eb2-bc77-feddcd4b6933 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:33:59.783588 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ac8689b7-ce60-4eb2-bc77-feddcd4b6933 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:59.784037 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ac8689b7-ce60-4eb2-bc77-feddcd4b6933 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:59.784818 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ac8689b7-ce60-4eb2-bc77-feddcd4b6933 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:33:59.785318 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ac8689b7-ce60-4eb2-bc77-feddcd4b6933 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:33:59.917969 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ac8689b7-ce60-4eb2-bc77-feddcd4b6933 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 13243 microversion: 2.1 time: 0.145642 Dec 20 03:33:59.918618 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 355/724] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:33:59 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 13243 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:34:00.098501 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a24d57bc-92fc-4352-99a1-426bbebe517b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:00.099091 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a24d57bc-92fc-4352-99a1-426bbebe517b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:00.105813 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a24d57bc-92fc-4352-99a1-426bbebe517b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:00.106253 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a24d57bc-92fc-4352-99a1-426bbebe517b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:00.107038 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a24d57bc-92fc-4352-99a1-426bbebe517b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:00.107636 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a24d57bc-92fc-4352-99a1-426bbebe517b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:00.245675 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-a24d57bc-92fc-4352-99a1-426bbebe517b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:00.253380 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a24d57bc-92fc-4352-99a1-426bbebe517b tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282" status: 200 len: 1514 microversion: 2.1 time: 0.158510 Dec 20 03:34:00.253970 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 370/725] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:00 2021] GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:00.447921 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d94bfbc6-3bd5-488b-9dcb-3340ea057fd2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:00.448630 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d94bfbc6-3bd5-488b-9dcb-3340ea057fd2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:00.455556 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d94bfbc6-3bd5-488b-9dcb-3340ea057fd2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:00.456066 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d94bfbc6-3bd5-488b-9dcb-3340ea057fd2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:00.456862 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d94bfbc6-3bd5-488b-9dcb-3340ea057fd2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:00.457337 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d94bfbc6-3bd5-488b-9dcb-3340ea057fd2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:00.659458 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d94bfbc6-3bd5-488b-9dcb-3340ea057fd2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:00.668227 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d94bfbc6-3bd5-488b-9dcb-3340ea057fd2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:00.670009 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d94bfbc6-3bd5-488b-9dcb-3340ea057fd2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:00.671151 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d94bfbc6-3bd5-488b-9dcb-3340ea057fd2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1406 microversion: 2.20 time: 0.228217 Dec 20 03:34:00.671782 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 356/726] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:34:00 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:34:00.686018 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-cd758bae-7030-4071-80ab-ccb0cbaf44f9 req-b55e07a6-80bc-41ab-9092-9bb2d037234f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa45c54-d54d-4db6-b5b0-095ed9fbf282", "name": "network-vif-deleted", "tag": "842047b2-0273-4a1a-b980-71e8c5a8478f"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:00.687679 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:34:00.687679 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:34:00.695149 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-cd758bae-7030-4071-80ab-ccb0cbaf44f9 req-b55e07a6-80bc-41ab-9092-9bb2d037234f service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:00.701210 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-cd758bae-7030-4071-80ab-ccb0cbaf44f9 req-b55e07a6-80bc-41ab-9092-9bb2d037234f service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:00.707309 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-cd758bae-7030-4071-80ab-ccb0cbaf44f9 req-b55e07a6-80bc-41ab-9092-9bb2d037234f service nova] Creating event network-vif-deleted:842047b2-0273-4a1a-b980-71e8c5a8478f for instance 9aa45c54-d54d-4db6-b5b0-095ed9fbf282 on hv-cinder-81803 Dec 20 03:34:00.712248 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-cd758bae-7030-4071-80ab-ccb0cbaf44f9 req-b55e07a6-80bc-41ab-9092-9bb2d037234f service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029855 Dec 20 03:34:00.712846 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 371/727] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:34:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:34:00.929456 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-16a02c3b-52ac-4de0-ba56-4bffe7f439a1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:00.931398 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-16a02c3b-52ac-4de0-ba56-4bffe7f439a1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:00.938069 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-16a02c3b-52ac-4de0-ba56-4bffe7f439a1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:00.938525 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-16a02c3b-52ac-4de0-ba56-4bffe7f439a1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:00.939363 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-16a02c3b-52ac-4de0-ba56-4bffe7f439a1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:00.939807 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-16a02c3b-52ac-4de0-ba56-4bffe7f439a1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:01.037113 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-e54335fe-675d-474f-bc20-3f5665ca9407 req-1b2b36f5-e09e-4cb5-9c0a-bd27934f65bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1645c1-a90b-406b-ba58-0620598ecf89", "name": "network-vif-plugged", "status": "completed", "tag": "31810791-54e6-413e-889b-510ef52f5b14"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:01.038694 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:34:01.038694 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:34:01.046869 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-e54335fe-675d-474f-bc20-3f5665ca9407 req-1b2b36f5-e09e-4cb5-9c0a-bd27934f65bf service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:01.047331 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-e54335fe-675d-474f-bc20-3f5665ca9407 req-1b2b36f5-e09e-4cb5-9c0a-bd27934f65bf service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:01.052901 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-16a02c3b-52ac-4de0-ba56-4bffe7f439a1 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 17808 microversion: 2.1 time: 0.126952 Dec 20 03:34:01.053879 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 357/728] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:00 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 17808 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:34:01.062095 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-e54335fe-675d-474f-bc20-3f5665ca9407 req-1b2b36f5-e09e-4cb5-9c0a-bd27934f65bf service nova] Creating event network-vif-plugged:31810791-54e6-413e-889b-510ef52f5b14 for instance 4a1645c1-a90b-406b-ba58-0620598ecf89 on hv-cinder-81803 Dec 20 03:34:01.067780 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-e54335fe-675d-474f-bc20-3f5665ca9407 req-1b2b36f5-e09e-4cb5-9c0a-bd27934f65bf service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033671 Dec 20 03:34:01.067909 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 372/729] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:34:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:34:01.271991 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-befcd42f-9f76-4a2b-8f7f-fd38048b2f15 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:01.272799 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-befcd42f-9f76-4a2b-8f7f-fd38048b2f15 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:01.280313 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-befcd42f-9f76-4a2b-8f7f-fd38048b2f15 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:01.280757 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-befcd42f-9f76-4a2b-8f7f-fd38048b2f15 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:01.281582 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-befcd42f-9f76-4a2b-8f7f-fd38048b2f15 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:01.282023 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-befcd42f-9f76-4a2b-8f7f-fd38048b2f15 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:01.314839 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-befcd42f-9f76-4a2b-8f7f-fd38048b2f15 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:01.315279 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-befcd42f-9f76-4a2b-8f7f-fd38048b2f15 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:01.315722 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.objects.instance [None req-befcd42f-9f76-4a2b-8f7f-fd38048b2f15 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lazy-loading 'fault' on Instance uuid 9aa45c54-d54d-4db6-b5b0-095ed9fbf282 {{(pid=117012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:34:01.355819 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-befcd42f-9f76-4a2b-8f7f-fd38048b2f15 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccfa6b8be514860a43d28ea40638220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b3f51f2d0f44ffab57b6f7798b66ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:01.363698 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-befcd42f-9f76-4a2b-8f7f-fd38048b2f15 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282" status: 200 len: 1309 microversion: 2.1 time: 0.095686 Dec 20 03:34:01.364294 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 358/730] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:01 2021] GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:01.690787 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-13bb94ca-b329-4ed9-90e2-38eec1d24701 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:01.691473 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-13bb94ca-b329-4ed9-90e2-38eec1d24701 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:01.698259 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-13bb94ca-b329-4ed9-90e2-38eec1d24701 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:01.698707 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-13bb94ca-b329-4ed9-90e2-38eec1d24701 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:01.699481 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-13bb94ca-b329-4ed9-90e2-38eec1d24701 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:01.699915 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-13bb94ca-b329-4ed9-90e2-38eec1d24701 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:02.066865 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-6846a7aa-d162-4b6c-bd7d-13d185f6a126 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:02.068122 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6846a7aa-d162-4b6c-bd7d-13d185f6a126 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:02.075684 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6846a7aa-d162-4b6c-bd7d-13d185f6a126 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:02.076142 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6846a7aa-d162-4b6c-bd7d-13d185f6a126 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:02.076939 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6846a7aa-d162-4b6c-bd7d-13d185f6a126 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:02.077466 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6846a7aa-d162-4b6c-bd7d-13d185f6a126 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:02.112901 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-13bb94ca-b329-4ed9-90e2-38eec1d24701 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:02.122193 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-13bb94ca-b329-4ed9-90e2-38eec1d24701 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:02.123952 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-13bb94ca-b329-4ed9-90e2-38eec1d24701 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:02.125059 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-13bb94ca-b329-4ed9-90e2-38eec1d24701 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1406 microversion: 2.20 time: 0.438876 Dec 20 03:34:02.125653 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 373/731] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:34:01 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1406 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:34:02.182219 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-6846a7aa-d162-4b6c-bd7d-13d185f6a126 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 18827 microversion: 2.1 time: 0.119523 Dec 20 03:34:02.182875 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 359/732] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:02 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 18827 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:34:02.381178 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-662cd381-6910-4ab4-be69-4028acc24f36 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:02.381787 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-662cd381-6910-4ab4-be69-4028acc24f36 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] [instance: 9aa45c54-d54d-4db6-b5b0-095ed9fbf282] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:02.387818 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-662cd381-6910-4ab4-be69-4028acc24f36 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:02.388259 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-662cd381-6910-4ab4-be69-4028acc24f36 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:02.389043 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-662cd381-6910-4ab4-be69-4028acc24f36 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:02.389509 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-662cd381-6910-4ab4-be69-4028acc24f36 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:02.403239 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-662cd381-6910-4ab4-be69-4028acc24f36 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] HTTP exception thrown: Instance 9aa45c54-d54d-4db6-b5b0-095ed9fbf282 could not be found. Dec 20 03:34:02.403831 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-662cd381-6910-4ab4-be69-4028acc24f36 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] Returning 404 to user: Instance 9aa45c54-d54d-4db6-b5b0-095ed9fbf282 could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:34:02.404662 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-662cd381-6910-4ab4-be69-4028acc24f36 tempest-VolumesSnapshotTestJSON-1427168734 tempest-VolumesSnapshotTestJSON-1427168734-project] 10.222.0.53 "GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282" status: 404 len: 111 microversion: 2.1 time: 0.027364 Dec 20 03:34:02.405258 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 374/733] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:02 2021] GET /compute/v2.1/servers/9aa45c54-d54d-4db6-b5b0-095ed9fbf282 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:34:02.974260 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-dbddd8d6-c3d6-4911-b40a-bede227eccd8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:02.975310 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-dbddd8d6-c3d6-4911-b40a-bede227eccd8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:02.983503 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dbddd8d6-c3d6-4911-b40a-bede227eccd8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:02.983957 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dbddd8d6-c3d6-4911-b40a-bede227eccd8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:02.984740 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dbddd8d6-c3d6-4911-b40a-bede227eccd8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:02.985204 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dbddd8d6-c3d6-4911-b40a-bede227eccd8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:03.143509 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-675a5946-b2eb-495f-a176-300162a5a4da tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:03.144120 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-675a5946-b2eb-495f-a176-300162a5a4da tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:03.151110 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-675a5946-b2eb-495f-a176-300162a5a4da tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:03.151565 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-675a5946-b2eb-495f-a176-300162a5a4da tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:03.152358 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-675a5946-b2eb-495f-a176-300162a5a4da tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:03.152806 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-675a5946-b2eb-495f-a176-300162a5a4da tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:03.159713 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-dbddd8d6-c3d6-4911-b40a-bede227eccd8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "POST /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a/action" status: 202 len: 0 microversion: 2.1 time: 0.192757 Dec 20 03:34:03.161832 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 360/734] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:02 2021] POST /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:03.168919 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-88b886b4-8e49-4c02-b9f9-5f5f023c3a03 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:03.169578 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-88b886b4-8e49-4c02-b9f9-5f5f023c3a03 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:03.176902 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-88b886b4-8e49-4c02-b9f9-5f5f023c3a03 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:03.177735 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-88b886b4-8e49-4c02-b9f9-5f5f023c3a03 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:03.179202 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-88b886b4-8e49-4c02-b9f9-5f5f023c3a03 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:03.179449 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-88b886b4-8e49-4c02-b9f9-5f5f023c3a03 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:03.307190 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-675a5946-b2eb-495f-a176-300162a5a4da tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:03.322278 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-675a5946-b2eb-495f-a176-300162a5a4da tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:03.323824 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-675a5946-b2eb-495f-a176-300162a5a4da tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:03.325011 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-675a5946-b2eb-495f-a176-300162a5a4da tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1599 microversion: 2.20 time: 0.185267 Dec 20 03:34:03.325608 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 375/735] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:34:03 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1599 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:34:03.330368 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f0f314aa-c8de-47ee-981d-b18404004846 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:03.331588 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-f0f314aa-c8de-47ee-981d-b18404004846 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:03.338445 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f0f314aa-c8de-47ee-981d-b18404004846 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:03.338898 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f0f314aa-c8de-47ee-981d-b18404004846 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:03.339707 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f0f314aa-c8de-47ee-981d-b18404004846 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:03.340143 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f0f314aa-c8de-47ee-981d-b18404004846 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:03.359401 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-88b886b4-8e49-4c02-b9f9-5f5f023c3a03 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:03.374642 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-88b886b4-8e49-4c02-b9f9-5f5f023c3a03 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1748 microversion: 2.1 time: 0.209461 Dec 20 03:34:03.375689 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 361/736] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:03 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1748 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:34:03.386991 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-37bc8fad-63f1-420f-90fe-ced0fb335e6f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:03.386991 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-37bc8fad-63f1-420f-90fe-ced0fb335e6f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:03.395843 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-37bc8fad-63f1-420f-90fe-ced0fb335e6f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:03.396664 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-37bc8fad-63f1-420f-90fe-ced0fb335e6f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:03.398105 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-37bc8fad-63f1-420f-90fe-ced0fb335e6f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:03.398808 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-37bc8fad-63f1-420f-90fe-ced0fb335e6f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:03.451334 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f0f314aa-c8de-47ee-981d-b18404004846 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 21282 microversion: 2.1 time: 0.124279 Dec 20 03:34:03.451983 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 376/737] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:03 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 21282 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:34:03.546832 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-37bc8fad-63f1-420f-90fe-ced0fb335e6f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.169897 Dec 20 03:34:03.547734 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 362/738] 10.222.0.53 () {60 vars in 1315 bytes} [Mon Dec 20 03:34:03 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/os-interface => generated 285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:34:04.404255 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-12e630ab-ff26-407a-9b71-be30ee6b208f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:04.404255 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-12e630ab-ff26-407a-9b71-be30ee6b208f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:04.416037 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-12e630ab-ff26-407a-9b71-be30ee6b208f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:04.416861 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-12e630ab-ff26-407a-9b71-be30ee6b208f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:04.418280 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-12e630ab-ff26-407a-9b71-be30ee6b208f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:04.419064 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-12e630ab-ff26-407a-9b71-be30ee6b208f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:04.467948 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c624c3e2-e7ac-48f2-b09d-eff259fb6a2c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:04.470584 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c624c3e2-e7ac-48f2-b09d-eff259fb6a2c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:04.480940 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c624c3e2-e7ac-48f2-b09d-eff259fb6a2c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:04.481718 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c624c3e2-e7ac-48f2-b09d-eff259fb6a2c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:04.483004 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c624c3e2-e7ac-48f2-b09d-eff259fb6a2c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:04.483759 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c624c3e2-e7ac-48f2-b09d-eff259fb6a2c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:04.608255 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c624c3e2-e7ac-48f2-b09d-eff259fb6a2c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 22942 microversion: 2.1 time: 0.147826 Dec 20 03:34:04.608931 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 363/739] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:04 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 22942 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:34:04.722250 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-12e630ab-ff26-407a-9b71-be30ee6b208f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:04.736702 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-12e630ab-ff26-407a-9b71-be30ee6b208f tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1748 microversion: 2.1 time: 0.341413 Dec 20 03:34:04.742407 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 377/740] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:04 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1748 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:04.748365 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-a3285ee3-122b-461d-be18-abbe560019f8 req-bd926cb5-ab2a-452b-9509-52bf9faf3531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a1645c1-a90b-406b-ba58-0620598ecf89", "tag": "31810791-54e6-413e-889b-510ef52f5b14"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:04.749150 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-4237f7f3-5cc0-4aa5-9e4e-b0cc24e9e20a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:04.749998 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:34:04.749998 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:34:04.750304 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-4237f7f3-5cc0-4aa5-9e4e-b0cc24e9e20a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:04.756792 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-a3285ee3-122b-461d-be18-abbe560019f8 req-bd926cb5-ab2a-452b-9509-52bf9faf3531 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:04.757266 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-a3285ee3-122b-461d-be18-abbe560019f8 req-bd926cb5-ab2a-452b-9509-52bf9faf3531 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:04.757399 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4237f7f3-5cc0-4aa5-9e4e-b0cc24e9e20a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:04.757872 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4237f7f3-5cc0-4aa5-9e4e-b0cc24e9e20a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:04.759339 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4237f7f3-5cc0-4aa5-9e4e-b0cc24e9e20a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:04.760084 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4237f7f3-5cc0-4aa5-9e4e-b0cc24e9e20a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:04.774609 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-a3285ee3-122b-461d-be18-abbe560019f8 req-bd926cb5-ab2a-452b-9509-52bf9faf3531 service nova] Creating event network-changed:31810791-54e6-413e-889b-510ef52f5b14 for instance 4a1645c1-a90b-406b-ba58-0620598ecf89 on hv-cinder-81803 Dec 20 03:34:04.781006 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-a3285ee3-122b-461d-be18-abbe560019f8 req-bd926cb5-ab2a-452b-9509-52bf9faf3531 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036114 Dec 20 03:34:04.782028 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 378/741] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:34:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:34:05.621818 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-74bd1f3c-8466-4eae-81e8-0c70f168ff61 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:05.622930 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-74bd1f3c-8466-4eae-81e8-0c70f168ff61 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:05.630537 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-74bd1f3c-8466-4eae-81e8-0c70f168ff61 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:05.631065 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-74bd1f3c-8466-4eae-81e8-0c70f168ff61 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:05.633328 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-74bd1f3c-8466-4eae-81e8-0c70f168ff61 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:05.633328 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-74bd1f3c-8466-4eae-81e8-0c70f168ff61 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:07.704151 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-4237f7f3-5cc0-4aa5-9e4e-b0cc24e9e20a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 14 microversion: 2.20 time: 2.959941 Dec 20 03:34:07.704892 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 364/742] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:04 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 14 bytes in 2962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:07.709919 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d9b2e5c4-9da9-432e-997c-84beec2d4b9e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:07.710686 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d9b2e5c4-9da9-432e-997c-84beec2d4b9e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:07.719600 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d9b2e5c4-9da9-432e-997c-84beec2d4b9e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:07.719936 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d9b2e5c4-9da9-432e-997c-84beec2d4b9e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:07.720745 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d9b2e5c4-9da9-432e-997c-84beec2d4b9e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:07.721207 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d9b2e5c4-9da9-432e-997c-84beec2d4b9e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:07.751060 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-74bd1f3c-8466-4eae-81e8-0c70f168ff61 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 25458 microversion: 2.1 time: 2.133978 Dec 20 03:34:07.752731 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 379/743] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:05 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 25458 bytes in 2137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:34:08.013788 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d9b2e5c4-9da9-432e-997c-84beec2d4b9e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:08.023312 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d9b2e5c4-9da9-432e-997c-84beec2d4b9e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1753 microversion: 2.1 time: 0.317164 Dec 20 03:34:08.024493 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 365/744] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:07 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1753 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:08.721047 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b10380c5-d455-41fe-914b-23ebf0467580 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:08.722507 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-b10380c5-d455-41fe-914b-23ebf0467580 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:08.731230 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b10380c5-d455-41fe-914b-23ebf0467580 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:08.731684 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b10380c5-d455-41fe-914b-23ebf0467580 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:08.732496 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b10380c5-d455-41fe-914b-23ebf0467580 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:08.732943 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b10380c5-d455-41fe-914b-23ebf0467580 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:08.765045 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ccb8dd04-5356-41af-837a-f9d1ade0acbf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:08.766205 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ccb8dd04-5356-41af-837a-f9d1ade0acbf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:08.774415 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ccb8dd04-5356-41af-837a-f9d1ade0acbf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:08.774931 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ccb8dd04-5356-41af-837a-f9d1ade0acbf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:08.775739 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ccb8dd04-5356-41af-837a-f9d1ade0acbf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:08.776180 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ccb8dd04-5356-41af-837a-f9d1ade0acbf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:08.855192 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b10380c5-d455-41fe-914b-23ebf0467580 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 14 microversion: 2.20 time: 0.140606 Dec 20 03:34:08.855988 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 380/745] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:08 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:08.906484 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ccb8dd04-5356-41af-837a-f9d1ade0acbf tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 26509 microversion: 2.1 time: 0.144870 Dec 20 03:34:08.907186 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 366/746] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:08 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 26509 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:34:09.050705 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-4e11d676-6534-4e9a-ac93-16b2ed25ce5c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:09.051530 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-4e11d676-6534-4e9a-ac93-16b2ed25ce5c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:09.059640 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4e11d676-6534-4e9a-ac93-16b2ed25ce5c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:09.060086 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4e11d676-6534-4e9a-ac93-16b2ed25ce5c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:09.060973 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4e11d676-6534-4e9a-ac93-16b2ed25ce5c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:09.061571 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4e11d676-6534-4e9a-ac93-16b2ed25ce5c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:09.216063 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-4e11d676-6534-4e9a-ac93-16b2ed25ce5c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:09.223989 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-4e11d676-6534-4e9a-ac93-16b2ed25ce5c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1753 microversion: 2.1 time: 0.177602 Dec 20 03:34:09.224550 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 381/747] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:09 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:09.866766 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-44ae59da-1d8b-4d28-a047-0227145fb4d3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:09.867856 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-44ae59da-1d8b-4d28-a047-0227145fb4d3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:09.876079 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-44ae59da-1d8b-4d28-a047-0227145fb4d3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:09.876529 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-44ae59da-1d8b-4d28-a047-0227145fb4d3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:09.877369 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-44ae59da-1d8b-4d28-a047-0227145fb4d3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:09.877806 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-44ae59da-1d8b-4d28-a047-0227145fb4d3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:09.918859 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0d797940-8899-41f1-a31e-375071cd2081 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:09.919799 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-0d797940-8899-41f1-a31e-375071cd2081 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:09.926222 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0d797940-8899-41f1-a31e-375071cd2081 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:09.931822 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0d797940-8899-41f1-a31e-375071cd2081 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:09.931822 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0d797940-8899-41f1-a31e-375071cd2081 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:09.931822 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0d797940-8899-41f1-a31e-375071cd2081 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:09.970503 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-44ae59da-1d8b-4d28-a047-0227145fb4d3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 14 microversion: 2.20 time: 0.107575 Dec 20 03:34:09.971182 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 367/748] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:09 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:34:10.036196 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-0d797940-8899-41f1-a31e-375071cd2081 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 27353 microversion: 2.1 time: 0.121191 Dec 20 03:34:10.037434 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 382/749] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:09 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 27353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:34:10.242504 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f388b33f-587a-43a0-bc3d-ffe1ebf30ffd tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:10.243854 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f388b33f-587a-43a0-bc3d-ffe1ebf30ffd tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:10.251134 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f388b33f-587a-43a0-bc3d-ffe1ebf30ffd tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:10.251590 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f388b33f-587a-43a0-bc3d-ffe1ebf30ffd tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:10.252402 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f388b33f-587a-43a0-bc3d-ffe1ebf30ffd tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:10.252935 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f388b33f-587a-43a0-bc3d-ffe1ebf30ffd tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:10.428713 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-f388b33f-587a-43a0-bc3d-ffe1ebf30ffd tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:10.437793 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f388b33f-587a-43a0-bc3d-ffe1ebf30ffd tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1753 microversion: 2.1 time: 0.199480 Dec 20 03:34:10.440092 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 368/750] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:10 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1753 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:10.981919 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-65e4788c-b464-4157-8be7-44d833887d30 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:10.982928 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-65e4788c-b464-4157-8be7-44d833887d30 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:10.990140 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-65e4788c-b464-4157-8be7-44d833887d30 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:10.990591 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-65e4788c-b464-4157-8be7-44d833887d30 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:10.991391 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-65e4788c-b464-4157-8be7-44d833887d30 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:10.991869 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-65e4788c-b464-4157-8be7-44d833887d30 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:11.048394 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-78ae2b5d-b146-40e2-b3d2-8ac1858f7112 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:11.049357 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-78ae2b5d-b146-40e2-b3d2-8ac1858f7112 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:11.056818 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-78ae2b5d-b146-40e2-b3d2-8ac1858f7112 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:11.057323 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-78ae2b5d-b146-40e2-b3d2-8ac1858f7112 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:11.058120 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-78ae2b5d-b146-40e2-b3d2-8ac1858f7112 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:11.058554 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-78ae2b5d-b146-40e2-b3d2-8ac1858f7112 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:11.091802 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-65e4788c-b464-4157-8be7-44d833887d30 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 14 microversion: 2.20 time: 0.113754 Dec 20 03:34:11.092442 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 383/751] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:10 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:11.162055 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-78ae2b5d-b146-40e2-b3d2-8ac1858f7112 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 27717 microversion: 2.1 time: 0.117100 Dec 20 03:34:11.162720 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 369/752] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:11 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 27717 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:34:11.456802 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-209df569-6623-4a42-b949-c17672d97ede tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:11.457401 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-209df569-6623-4a42-b949-c17672d97ede tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:11.464618 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-209df569-6623-4a42-b949-c17672d97ede tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:11.465060 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-209df569-6623-4a42-b949-c17672d97ede tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:11.465903 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-209df569-6623-4a42-b949-c17672d97ede tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:11.466333 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-209df569-6623-4a42-b949-c17672d97ede tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:11.631754 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-209df569-6623-4a42-b949-c17672d97ede tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:11.640757 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-209df569-6623-4a42-b949-c17672d97ede tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1753 microversion: 2.1 time: 0.188016 Dec 20 03:34:11.641360 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 384/753] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:11 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:12.102559 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-b6568a64-009a-4356-bcbb-7fb0b7fd39ea tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:12.103647 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-b6568a64-009a-4356-bcbb-7fb0b7fd39ea tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:12.110467 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b6568a64-009a-4356-bcbb-7fb0b7fd39ea tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:12.110919 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b6568a64-009a-4356-bcbb-7fb0b7fd39ea tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:12.111691 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b6568a64-009a-4356-bcbb-7fb0b7fd39ea tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:12.112124 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b6568a64-009a-4356-bcbb-7fb0b7fd39ea tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:12.176895 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a27bd0d7-2267-4f2f-b64c-264b98305a3f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:12.179356 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a27bd0d7-2267-4f2f-b64c-264b98305a3f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:12.188433 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a27bd0d7-2267-4f2f-b64c-264b98305a3f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:12.189019 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a27bd0d7-2267-4f2f-b64c-264b98305a3f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:12.189853 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a27bd0d7-2267-4f2f-b64c-264b98305a3f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:12.190289 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a27bd0d7-2267-4f2f-b64c-264b98305a3f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:12.204209 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-b6568a64-009a-4356-bcbb-7fb0b7fd39ea tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 14 microversion: 2.20 time: 0.103238 Dec 20 03:34:12.208846 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 370/754] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:12 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:12.293047 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a27bd0d7-2267-4f2f-b64c-264b98305a3f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 28198 microversion: 2.1 time: 0.123015 Dec 20 03:34:12.294128 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 385/755] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:12 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 28198 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:34:12.662300 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-348e1493-400a-45a0-a42f-846f697c6041 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:12.662904 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-348e1493-400a-45a0-a42f-846f697c6041 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:12.670610 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-348e1493-400a-45a0-a42f-846f697c6041 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:12.671057 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-348e1493-400a-45a0-a42f-846f697c6041 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:12.671837 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-348e1493-400a-45a0-a42f-846f697c6041 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:12.672269 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-348e1493-400a-45a0-a42f-846f697c6041 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:12.830396 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-348e1493-400a-45a0-a42f-846f697c6041 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:12.838569 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-348e1493-400a-45a0-a42f-846f697c6041 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1753 microversion: 2.1 time: 0.181107 Dec 20 03:34:12.839140 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 371/756] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:12 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:13.217009 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-896a095e-96d1-4271-a662-7bedd252f56c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:13.218073 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-896a095e-96d1-4271-a662-7bedd252f56c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:13.225605 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-896a095e-96d1-4271-a662-7bedd252f56c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:13.226058 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-896a095e-96d1-4271-a662-7bedd252f56c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:13.226853 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-896a095e-96d1-4271-a662-7bedd252f56c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:13.227290 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-896a095e-96d1-4271-a662-7bedd252f56c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:13.304443 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-35ea3daf-9dbf-4c2b-83c7-70c69c6236be tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:13.305415 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-35ea3daf-9dbf-4c2b-83c7-70c69c6236be tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:13.313078 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-35ea3daf-9dbf-4c2b-83c7-70c69c6236be tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:13.313078 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-35ea3daf-9dbf-4c2b-83c7-70c69c6236be tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:13.313906 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-35ea3daf-9dbf-4c2b-83c7-70c69c6236be tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:13.314194 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-35ea3daf-9dbf-4c2b-83c7-70c69c6236be tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:13.336589 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-896a095e-96d1-4271-a662-7bedd252f56c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 14 microversion: 2.20 time: 0.123729 Dec 20 03:34:13.340827 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 386/757] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:13 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:34:13.412118 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-35ea3daf-9dbf-4c2b-83c7-70c69c6236be tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 28198 microversion: 2.1 time: 0.111102 Dec 20 03:34:13.412749 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 372/758] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:13 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 28198 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:34:13.856046 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-16be4860-2d98-46e0-ab85-b560a8a75196 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:13.861471 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-16be4860-2d98-46e0-ab85-b560a8a75196 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:13.864560 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-16be4860-2d98-46e0-ab85-b560a8a75196 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:13.865006 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-16be4860-2d98-46e0-ab85-b560a8a75196 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:13.865992 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-16be4860-2d98-46e0-ab85-b560a8a75196 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:13.866431 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-16be4860-2d98-46e0-ab85-b560a8a75196 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:14.024347 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-16be4860-2d98-46e0-ab85-b560a8a75196 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:14.032492 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-16be4860-2d98-46e0-ab85-b560a8a75196 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1753 microversion: 2.1 time: 0.180755 Dec 20 03:34:14.033072 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 387/759] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:13 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:14.348962 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-29b76d40-bf0d-4137-989a-17765fd9baf6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:14.349990 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-29b76d40-bf0d-4137-989a-17765fd9baf6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:14.357109 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-29b76d40-bf0d-4137-989a-17765fd9baf6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:14.357596 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-29b76d40-bf0d-4137-989a-17765fd9baf6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:14.358382 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-29b76d40-bf0d-4137-989a-17765fd9baf6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:14.358820 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-29b76d40-bf0d-4137-989a-17765fd9baf6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:14.425901 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-701ceb6f-8d3b-48dd-b363-190e7d6f5d5a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:14.426817 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-701ceb6f-8d3b-48dd-b363-190e7d6f5d5a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:14.433374 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-701ceb6f-8d3b-48dd-b363-190e7d6f5d5a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:14.433824 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-701ceb6f-8d3b-48dd-b363-190e7d6f5d5a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:14.434609 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-701ceb6f-8d3b-48dd-b363-190e7d6f5d5a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:14.435043 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-701ceb6f-8d3b-48dd-b363-190e7d6f5d5a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:17.083510 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-29b76d40-bf0d-4137-989a-17765fd9baf6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 14 microversion: 2.20 time: 2.733518 Dec 20 03:34:17.083510 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 373/760] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:14 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 14 bytes in 2735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:17.084387 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-22905b49-0916-496e-a949-85cf77f8e2cd tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:17.085112 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-22905b49-0916-496e-a949-85cf77f8e2cd tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:17.093959 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-22905b49-0916-496e-a949-85cf77f8e2cd tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:17.094415 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-22905b49-0916-496e-a949-85cf77f8e2cd tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:17.095222 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-22905b49-0916-496e-a949-85cf77f8e2cd tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:17.095666 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-22905b49-0916-496e-a949-85cf77f8e2cd tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:17.112532 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-701ceb6f-8d3b-48dd-b363-190e7d6f5d5a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 28198 microversion: 2.1 time: 2.690092 Dec 20 03:34:17.116440 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 388/761] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:14 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 28198 bytes in 2692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:34:17.247575 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-22905b49-0916-496e-a949-85cf77f8e2cd tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:17.255762 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-22905b49-0916-496e-a949-85cf77f8e2cd tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1753 microversion: 2.1 time: 0.175331 Dec 20 03:34:17.256330 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 374/762] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:17 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:18.094431 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-66576ba1-1090-46d4-a836-ee4b5b180f6a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:18.095385 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-66576ba1-1090-46d4-a836-ee4b5b180f6a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:18.102434 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-66576ba1-1090-46d4-a836-ee4b5b180f6a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:18.102895 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-66576ba1-1090-46d4-a836-ee4b5b180f6a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:18.103776 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-66576ba1-1090-46d4-a836-ee4b5b180f6a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:18.104217 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-66576ba1-1090-46d4-a836-ee4b5b180f6a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:18.124518 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1d23c70a-7d65-4e15-acdb-a17e1f24ec6e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:18.125635 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1d23c70a-7d65-4e15-acdb-a17e1f24ec6e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:18.132323 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1d23c70a-7d65-4e15-acdb-a17e1f24ec6e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:18.132874 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1d23c70a-7d65-4e15-acdb-a17e1f24ec6e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:18.133705 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1d23c70a-7d65-4e15-acdb-a17e1f24ec6e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:18.134149 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1d23c70a-7d65-4e15-acdb-a17e1f24ec6e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:18.226542 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-66576ba1-1090-46d4-a836-ee4b5b180f6a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 14 microversion: 2.20 time: 0.136364 Dec 20 03:34:18.227345 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 389/763] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:18 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:34:18.267913 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1d23c70a-7d65-4e15-acdb-a17e1f24ec6e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 28489 microversion: 2.1 time: 0.147187 Dec 20 03:34:18.269410 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 375/764] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:18 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 28489 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:34:18.273446 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-9cb7a8b5-74dd-4252-91d7-a3fb469f6ad2 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:18.274223 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-9cb7a8b5-74dd-4252-91d7-a3fb469f6ad2 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:18.282013 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9cb7a8b5-74dd-4252-91d7-a3fb469f6ad2 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:18.282455 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9cb7a8b5-74dd-4252-91d7-a3fb469f6ad2 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:18.283277 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9cb7a8b5-74dd-4252-91d7-a3fb469f6ad2 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:18.283739 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9cb7a8b5-74dd-4252-91d7-a3fb469f6ad2 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:18.460618 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9cb7a8b5-74dd-4252-91d7-a3fb469f6ad2 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:18.469710 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-9cb7a8b5-74dd-4252-91d7-a3fb469f6ad2 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1753 microversion: 2.1 time: 0.200334 Dec 20 03:34:18.470287 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 390/765] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:18 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1753 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:19.238592 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1a4e694a-cfb4-4d19-be48-8cdc303bb75f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:19.239705 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1a4e694a-cfb4-4d19-be48-8cdc303bb75f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:19.247440 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1a4e694a-cfb4-4d19-be48-8cdc303bb75f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:19.247890 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1a4e694a-cfb4-4d19-be48-8cdc303bb75f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:19.248943 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1a4e694a-cfb4-4d19-be48-8cdc303bb75f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:19.249411 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1a4e694a-cfb4-4d19-be48-8cdc303bb75f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:19.282206 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b11b7a77-84a1-41ce-abe0-c545f50daa5c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:19.283924 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-b11b7a77-84a1-41ce-abe0-c545f50daa5c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:19.291335 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b11b7a77-84a1-41ce-abe0-c545f50daa5c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:19.291790 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b11b7a77-84a1-41ce-abe0-c545f50daa5c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:19.292680 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b11b7a77-84a1-41ce-abe0-c545f50daa5c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:19.293128 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b11b7a77-84a1-41ce-abe0-c545f50daa5c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:19.374219 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1a4e694a-cfb4-4d19-be48-8cdc303bb75f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 8434 microversion: 2.20 time: 0.139816 Dec 20 03:34:19.375064 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 376/766] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:19 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 8434 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:34:19.412762 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b11b7a77-84a1-41ce-abe0-c545f50daa5c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 28657 microversion: 2.1 time: 0.135838 Dec 20 03:34:19.413487 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 391/767] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:19 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 28657 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:34:19.490078 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-8ba934a6-b8f0-4101-9e0a-2124fc046b06 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:19.490720 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-8ba934a6-b8f0-4101-9e0a-2124fc046b06 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:19.499076 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8ba934a6-b8f0-4101-9e0a-2124fc046b06 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:19.499689 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8ba934a6-b8f0-4101-9e0a-2124fc046b06 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:19.500499 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8ba934a6-b8f0-4101-9e0a-2124fc046b06 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:19.501066 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8ba934a6-b8f0-4101-9e0a-2124fc046b06 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:19.662365 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-8ba934a6-b8f0-4101-9e0a-2124fc046b06 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:19.671038 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-8ba934a6-b8f0-4101-9e0a-2124fc046b06 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1753 microversion: 2.1 time: 0.185221 Dec 20 03:34:19.671595 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 377/768] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:19 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:20.387676 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-108922ed-0cf2-4015-8f64-7c74c31c51a0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:20.389081 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-108922ed-0cf2-4015-8f64-7c74c31c51a0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:20.395800 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-108922ed-0cf2-4015-8f64-7c74c31c51a0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:20.396255 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-108922ed-0cf2-4015-8f64-7c74c31c51a0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:20.397050 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-108922ed-0cf2-4015-8f64-7c74c31c51a0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:20.397509 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-108922ed-0cf2-4015-8f64-7c74c31c51a0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:20.424616 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c49422a2-177d-4c20-96c8-bbf3e6679bce tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:20.425598 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c49422a2-177d-4c20-96c8-bbf3e6679bce tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:20.435357 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c49422a2-177d-4c20-96c8-bbf3e6679bce tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:20.435357 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c49422a2-177d-4c20-96c8-bbf3e6679bce tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:20.435357 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c49422a2-177d-4c20-96c8-bbf3e6679bce tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:20.435357 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c49422a2-177d-4c20-96c8-bbf3e6679bce tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:20.514455 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-108922ed-0cf2-4015-8f64-7c74c31c51a0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 16057 microversion: 2.20 time: 0.131426 Dec 20 03:34:20.515103 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 392/769] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:20 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 16057 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:20.541735 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c49422a2-177d-4c20-96c8-bbf3e6679bce tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 28657 microversion: 2.1 time: 0.120603 Dec 20 03:34:20.542546 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 378/770] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:20 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 28657 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:34:20.688745 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-6a817a55-acc7-4371-941a-361f44a6e79e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:20.689378 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6a817a55-acc7-4371-941a-361f44a6e79e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:20.696235 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6a817a55-acc7-4371-941a-361f44a6e79e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:20.696691 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6a817a55-acc7-4371-941a-361f44a6e79e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:20.698219 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6a817a55-acc7-4371-941a-361f44a6e79e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:20.698659 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6a817a55-acc7-4371-941a-361f44a6e79e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:20.854769 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6a817a55-acc7-4371-941a-361f44a6e79e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:20.863371 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-6a817a55-acc7-4371-941a-361f44a6e79e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1753 microversion: 2.1 time: 0.178594 Dec 20 03:34:20.863950 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 393/771] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:20 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:21.527352 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-695fa5d8-8df9-4bee-a07f-6d646abcc96c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:21.528354 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-695fa5d8-8df9-4bee-a07f-6d646abcc96c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:21.535477 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-695fa5d8-8df9-4bee-a07f-6d646abcc96c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:21.535937 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-695fa5d8-8df9-4bee-a07f-6d646abcc96c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:21.536721 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-695fa5d8-8df9-4bee-a07f-6d646abcc96c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:21.537184 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-695fa5d8-8df9-4bee-a07f-6d646abcc96c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:21.554148 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0bd8a867-75db-4b38-bcc5-955de424bc35 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:21.555107 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-0bd8a867-75db-4b38-bcc5-955de424bc35 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:21.561622 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0bd8a867-75db-4b38-bcc5-955de424bc35 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:21.562044 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0bd8a867-75db-4b38-bcc5-955de424bc35 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:21.562833 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0bd8a867-75db-4b38-bcc5-955de424bc35 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:21.563282 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0bd8a867-75db-4b38-bcc5-955de424bc35 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:21.657616 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-695fa5d8-8df9-4bee-a07f-6d646abcc96c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 18356 microversion: 2.20 time: 0.135030 Dec 20 03:34:21.658303 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 379/772] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:21 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 18356 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:21.692205 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-0bd8a867-75db-4b38-bcc5-955de424bc35 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 28657 microversion: 2.1 time: 0.141989 Dec 20 03:34:21.692885 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 394/773] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:21 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 28657 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:34:21.881790 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7fd18191-e5c2-48b6-990a-2948276f5a12 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:21.882487 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-7fd18191-e5c2-48b6-990a-2948276f5a12 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:21.890139 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7fd18191-e5c2-48b6-990a-2948276f5a12 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:21.890588 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7fd18191-e5c2-48b6-990a-2948276f5a12 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:21.891359 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7fd18191-e5c2-48b6-990a-2948276f5a12 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:21.891799 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7fd18191-e5c2-48b6-990a-2948276f5a12 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:22.041706 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7fd18191-e5c2-48b6-990a-2948276f5a12 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:22.049425 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7fd18191-e5c2-48b6-990a-2948276f5a12 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1753 microversion: 2.1 time: 0.171642 Dec 20 03:34:22.049983 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 380/774] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:21 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:22.671743 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f4a03ee7-c721-4da8-bf33-5e8836ed4f12 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:22.672687 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-f4a03ee7-c721-4da8-bf33-5e8836ed4f12 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:22.679604 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f4a03ee7-c721-4da8-bf33-5e8836ed4f12 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:22.680046 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f4a03ee7-c721-4da8-bf33-5e8836ed4f12 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:22.680816 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f4a03ee7-c721-4da8-bf33-5e8836ed4f12 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:22.681278 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f4a03ee7-c721-4da8-bf33-5e8836ed4f12 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:22.704144 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-57cc9947-107b-480f-97a5-f97d3708a8a0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:22.705064 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-57cc9947-107b-480f-97a5-f97d3708a8a0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:22.711633 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-57cc9947-107b-480f-97a5-f97d3708a8a0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:22.720025 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-57cc9947-107b-480f-97a5-f97d3708a8a0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:22.720025 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-57cc9947-107b-480f-97a5-f97d3708a8a0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:22.720025 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-57cc9947-107b-480f-97a5-f97d3708a8a0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:22.788651 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f4a03ee7-c721-4da8-bf33-5e8836ed4f12 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 19774 microversion: 2.20 time: 0.122690 Dec 20 03:34:22.789458 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 395/775] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:22 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 19774 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:22.823023 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-57cc9947-107b-480f-97a5-f97d3708a8a0 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 28657 microversion: 2.1 time: 0.122308 Dec 20 03:34:22.823814 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 381/776] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:22 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 28657 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:34:23.068329 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-2721af3f-f096-4f2f-a968-f89375d35bed tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:23.069023 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-2721af3f-f096-4f2f-a968-f89375d35bed tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:23.075985 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2721af3f-f096-4f2f-a968-f89375d35bed tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:23.076434 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2721af3f-f096-4f2f-a968-f89375d35bed tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:23.077240 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2721af3f-f096-4f2f-a968-f89375d35bed tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:23.077675 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2721af3f-f096-4f2f-a968-f89375d35bed tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:23.226258 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-2721af3f-f096-4f2f-a968-f89375d35bed tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:23.234174 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-2721af3f-f096-4f2f-a968-f89375d35bed tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1753 microversion: 2.1 time: 0.170022 Dec 20 03:34:23.234745 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 396/777] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:23 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:23.802584 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-98aa27de-2a57-45da-99b4-74d408c65bd5 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:23.803486 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-98aa27de-2a57-45da-99b4-74d408c65bd5 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:23.811576 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-98aa27de-2a57-45da-99b4-74d408c65bd5 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:23.816314 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-98aa27de-2a57-45da-99b4-74d408c65bd5 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:23.816314 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-98aa27de-2a57-45da-99b4-74d408c65bd5 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:23.816314 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-98aa27de-2a57-45da-99b4-74d408c65bd5 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:23.834654 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-7febcb95-83b8-4166-b87d-0154243a335d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:23.835602 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-7febcb95-83b8-4166-b87d-0154243a335d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:23.843504 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7febcb95-83b8-4166-b87d-0154243a335d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:23.843504 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7febcb95-83b8-4166-b87d-0154243a335d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:23.844176 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7febcb95-83b8-4166-b87d-0154243a335d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:23.844609 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7febcb95-83b8-4166-b87d-0154243a335d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:23.918850 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-98aa27de-2a57-45da-99b4-74d408c65bd5 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 22216 microversion: 2.20 time: 0.120272 Dec 20 03:34:23.919496 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 382/778] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:23 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 22216 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:23.956510 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-7febcb95-83b8-4166-b87d-0154243a335d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 29145 microversion: 2.1 time: 0.125292 Dec 20 03:34:23.957442 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 397/779] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:23 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 29145 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:34:24.252256 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c19c775d-9713-4ae5-a148-ccbf0a128631 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:24.252961 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c19c775d-9713-4ae5-a148-ccbf0a128631 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:24.260410 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c19c775d-9713-4ae5-a148-ccbf0a128631 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:24.260900 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c19c775d-9713-4ae5-a148-ccbf0a128631 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:24.261734 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c19c775d-9713-4ae5-a148-ccbf0a128631 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:24.262175 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c19c775d-9713-4ae5-a148-ccbf0a128631 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:24.412691 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c19c775d-9713-4ae5-a148-ccbf0a128631 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:24.420798 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c19c775d-9713-4ae5-a148-ccbf0a128631 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1753 microversion: 2.1 time: 0.172768 Dec 20 03:34:24.421414 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 383/780] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:24 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:34:24.932948 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-eb0b8409-4950-4990-9ee1-eddde8442341 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:24.934042 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-eb0b8409-4950-4990-9ee1-eddde8442341 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:24.941177 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eb0b8409-4950-4990-9ee1-eddde8442341 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:24.941630 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eb0b8409-4950-4990-9ee1-eddde8442341 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:24.942430 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eb0b8409-4950-4990-9ee1-eddde8442341 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:24.942869 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eb0b8409-4950-4990-9ee1-eddde8442341 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:24.968033 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c0d84af0-51da-4ce2-951a-783bd9d7e2b2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:24.969791 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c0d84af0-51da-4ce2-951a-783bd9d7e2b2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:24.977255 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c0d84af0-51da-4ce2-951a-783bd9d7e2b2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:24.977717 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c0d84af0-51da-4ce2-951a-783bd9d7e2b2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:24.979183 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c0d84af0-51da-4ce2-951a-783bd9d7e2b2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:24.979597 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c0d84af0-51da-4ce2-951a-783bd9d7e2b2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:25.056534 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-eb0b8409-4950-4990-9ee1-eddde8442341 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 23803 microversion: 2.20 time: 0.129527 Dec 20 03:34:25.058277 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 398/781] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:24 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 23803 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:25.091856 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c0d84af0-51da-4ce2-951a-783bd9d7e2b2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 30995 microversion: 2.1 time: 0.127258 Dec 20 03:34:25.092745 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 384/782] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:24 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 30995 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:34:25.438861 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e032705c-98d3-403c-8094-2a38d4ebbfff tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:25.439548 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e032705c-98d3-403c-8094-2a38d4ebbfff tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:25.446640 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e032705c-98d3-403c-8094-2a38d4ebbfff tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:25.447182 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e032705c-98d3-403c-8094-2a38d4ebbfff tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:25.447962 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e032705c-98d3-403c-8094-2a38d4ebbfff tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:25.448400 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e032705c-98d3-403c-8094-2a38d4ebbfff tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:25.595264 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-e032705c-98d3-403c-8094-2a38d4ebbfff tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:25.603331 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e032705c-98d3-403c-8094-2a38d4ebbfff tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1753 microversion: 2.1 time: 0.168460 Dec 20 03:34:25.603900 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 399/783] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:25 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:26.069553 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-83d72ede-8043-48bd-aa56-542977ad2dc0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:26.070547 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-83d72ede-8043-48bd-aa56-542977ad2dc0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:26.078010 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-83d72ede-8043-48bd-aa56-542977ad2dc0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:26.078372 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-83d72ede-8043-48bd-aa56-542977ad2dc0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:26.079161 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-83d72ede-8043-48bd-aa56-542977ad2dc0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:26.079597 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-83d72ede-8043-48bd-aa56-542977ad2dc0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:26.102854 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-5fe9858a-e67a-41a0-b123-413f7a2e322c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:26.103756 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-5fe9858a-e67a-41a0-b123-413f7a2e322c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:26.112213 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5fe9858a-e67a-41a0-b123-413f7a2e322c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:26.112653 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5fe9858a-e67a-41a0-b123-413f7a2e322c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:26.113490 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5fe9858a-e67a-41a0-b123-413f7a2e322c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:26.113922 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5fe9858a-e67a-41a0-b123-413f7a2e322c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:26.203293 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-83d72ede-8043-48bd-aa56-542977ad2dc0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 25357 microversion: 2.20 time: 0.137713 Dec 20 03:34:26.204232 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 385/784] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:26 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 25357 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:26.237839 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-5fe9858a-e67a-41a0-b123-413f7a2e322c tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 32760 microversion: 2.1 time: 0.138435 Dec 20 03:34:26.238664 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 400/785] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:26 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 32760 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:34:26.621516 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-63b00de7-a8ca-4e12-b1da-8fce226713da tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:26.622130 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-63b00de7-a8ca-4e12-b1da-8fce226713da tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:26.629410 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-63b00de7-a8ca-4e12-b1da-8fce226713da tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:26.630171 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-63b00de7-a8ca-4e12-b1da-8fce226713da tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:26.631065 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-63b00de7-a8ca-4e12-b1da-8fce226713da tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:26.631509 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-63b00de7-a8ca-4e12-b1da-8fce226713da tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:26.796763 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-63b00de7-a8ca-4e12-b1da-8fce226713da tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:26.805460 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-63b00de7-a8ca-4e12-b1da-8fce226713da tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1753 microversion: 2.1 time: 0.187989 Dec 20 03:34:26.809785 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 386/786] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:26 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1753 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:27.220937 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1c82c6c0-815d-49ad-896a-f6dadf61c5ff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:27.222747 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1c82c6c0-815d-49ad-896a-f6dadf61c5ff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:27.234794 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1c82c6c0-815d-49ad-896a-f6dadf61c5ff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:27.235253 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1c82c6c0-815d-49ad-896a-f6dadf61c5ff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:27.236619 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1c82c6c0-815d-49ad-896a-f6dadf61c5ff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:27.237106 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1c82c6c0-815d-49ad-896a-f6dadf61c5ff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:27.250555 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a52921cf-367a-4b4d-beeb-c6488a54913d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:27.251486 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a52921cf-367a-4b4d-beeb-c6488a54913d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:27.263653 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a52921cf-367a-4b4d-beeb-c6488a54913d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:27.264113 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a52921cf-367a-4b4d-beeb-c6488a54913d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:27.264912 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a52921cf-367a-4b4d-beeb-c6488a54913d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:27.265409 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a52921cf-367a-4b4d-beeb-c6488a54913d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:27.358474 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1c82c6c0-815d-49ad-896a-f6dadf61c5ff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 26783 microversion: 2.20 time: 0.145588 Dec 20 03:34:27.359261 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 401/787] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:27 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 26783 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:27.383070 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a52921cf-367a-4b4d-beeb-c6488a54913d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 33683 microversion: 2.1 time: 0.136810 Dec 20 03:34:27.383702 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 387/788] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:27 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 33683 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:34:27.823511 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-76ea2764-a8fe-4f0e-a1d7-8e01933883c2 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:27.824255 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-76ea2764-a8fe-4f0e-a1d7-8e01933883c2 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:27.831247 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-76ea2764-a8fe-4f0e-a1d7-8e01933883c2 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:27.831690 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-76ea2764-a8fe-4f0e-a1d7-8e01933883c2 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:27.832465 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-76ea2764-a8fe-4f0e-a1d7-8e01933883c2 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:27.832898 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-76ea2764-a8fe-4f0e-a1d7-8e01933883c2 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:27.987269 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-76ea2764-a8fe-4f0e-a1d7-8e01933883c2 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:27.995181 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-76ea2764-a8fe-4f0e-a1d7-8e01933883c2 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1753 microversion: 2.1 time: 0.175681 Dec 20 03:34:27.995751 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 402/789] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:27 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:28.370858 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c639fc1b-275d-4168-9fae-e0f3123281cf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:28.371913 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c639fc1b-275d-4168-9fae-e0f3123281cf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:28.379579 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c639fc1b-275d-4168-9fae-e0f3123281cf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:28.380034 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c639fc1b-275d-4168-9fae-e0f3123281cf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:28.380822 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c639fc1b-275d-4168-9fae-e0f3123281cf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:28.381301 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c639fc1b-275d-4168-9fae-e0f3123281cf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:28.397656 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-c0817443-e42d-42e7-b743-7008e73fc19f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:28.398597 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-c0817443-e42d-42e7-b743-7008e73fc19f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:28.405903 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c0817443-e42d-42e7-b743-7008e73fc19f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:28.406362 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c0817443-e42d-42e7-b743-7008e73fc19f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:28.407743 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c0817443-e42d-42e7-b743-7008e73fc19f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:28.407743 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c0817443-e42d-42e7-b743-7008e73fc19f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:28.525611 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-c0817443-e42d-42e7-b743-7008e73fc19f tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 34530 microversion: 2.1 time: 0.133036 Dec 20 03:34:28.526279 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 403/790] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:28 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 34530 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:34:28.549442 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c639fc1b-275d-4168-9fae-e0f3123281cf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 27535 microversion: 2.20 time: 0.182476 Dec 20 03:34:28.550103 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 388/791] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:28 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 27535 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:29.017236 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-da2b9730-3f9a-47de-a7e9-77e571fc64fc tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:29.018079 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-da2b9730-3f9a-47de-a7e9-77e571fc64fc tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:29.025525 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-da2b9730-3f9a-47de-a7e9-77e571fc64fc tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:29.026004 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-da2b9730-3f9a-47de-a7e9-77e571fc64fc tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:29.028674 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-da2b9730-3f9a-47de-a7e9-77e571fc64fc tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:29.028674 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-da2b9730-3f9a-47de-a7e9-77e571fc64fc tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:29.207193 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-da2b9730-3f9a-47de-a7e9-77e571fc64fc tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:29.216065 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-da2b9730-3f9a-47de-a7e9-77e571fc64fc tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1756 microversion: 2.1 time: 0.202821 Dec 20 03:34:29.216453 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 404/792] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:34:29 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1756 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:34:29.539915 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-8acd7b8d-088b-48c1-b93f-9c481e3af27b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:29.541105 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-8acd7b8d-088b-48c1-b93f-9c481e3af27b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:29.549271 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8acd7b8d-088b-48c1-b93f-9c481e3af27b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:29.549724 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8acd7b8d-088b-48c1-b93f-9c481e3af27b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:29.550517 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8acd7b8d-088b-48c1-b93f-9c481e3af27b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:29.550954 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8acd7b8d-088b-48c1-b93f-9c481e3af27b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:29.568507 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-550377bd-4bdb-4bc9-b520-273432b81148 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:29.580362 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-550377bd-4bdb-4bc9-b520-273432b81148 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:29.580362 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-550377bd-4bdb-4bc9-b520-273432b81148 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:29.580362 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-550377bd-4bdb-4bc9-b520-273432b81148 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:29.580362 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-550377bd-4bdb-4bc9-b520-273432b81148 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:29.580834 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-550377bd-4bdb-4bc9-b520-273432b81148 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:29.662892 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-8acd7b8d-088b-48c1-b93f-9c481e3af27b tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 35519 microversion: 2.1 time: 0.127548 Dec 20 03:34:29.663833 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 389/793] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:29 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 35519 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:34:29.847213 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-550377bd-4bdb-4bc9-b520-273432b81148 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 28020 microversion: 2.20 time: 0.282348 Dec 20 03:34:29.848003 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 405/794] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:29 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 28020 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:30.679169 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-968cfb2c-1dac-4383-8769-41a5f580d89a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:30.680383 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-968cfb2c-1dac-4383-8769-41a5f580d89a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:30.688142 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-968cfb2c-1dac-4383-8769-41a5f580d89a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:30.688595 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-968cfb2c-1dac-4383-8769-41a5f580d89a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:30.689419 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-968cfb2c-1dac-4383-8769-41a5f580d89a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:30.689889 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-968cfb2c-1dac-4383-8769-41a5f580d89a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:30.802845 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-968cfb2c-1dac-4383-8769-41a5f580d89a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 36993 microversion: 2.1 time: 0.127542 Dec 20 03:34:30.803633 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 390/795] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:30 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 36993 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:34:30.861901 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-5fc2aeee-decc-4bda-acc9-eccc86a7e55e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:30.867747 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-5fc2aeee-decc-4bda-acc9-eccc86a7e55e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:30.872885 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5fc2aeee-decc-4bda-acc9-eccc86a7e55e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:30.873826 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5fc2aeee-decc-4bda-acc9-eccc86a7e55e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:30.874742 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5fc2aeee-decc-4bda-acc9-eccc86a7e55e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:30.875279 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5fc2aeee-decc-4bda-acc9-eccc86a7e55e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:30.989192 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-5fc2aeee-decc-4bda-acc9-eccc86a7e55e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 28209 microversion: 2.20 time: 0.132160 Dec 20 03:34:30.989763 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 406/796] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:30 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 28209 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:31.817843 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-25ee6db5-cc21-4e68-9fbd-3140c9f8f5f6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:31.819625 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-25ee6db5-cc21-4e68-9fbd-3140c9f8f5f6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:31.829096 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-25ee6db5-cc21-4e68-9fbd-3140c9f8f5f6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:31.829578 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-25ee6db5-cc21-4e68-9fbd-3140c9f8f5f6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:31.830404 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-25ee6db5-cc21-4e68-9fbd-3140c9f8f5f6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:31.830834 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-25ee6db5-cc21-4e68-9fbd-3140c9f8f5f6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:31.930382 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-25ee6db5-cc21-4e68-9fbd-3140c9f8f5f6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 38187 microversion: 2.1 time: 0.116461 Dec 20 03:34:31.931026 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 391/797] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:31 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 38187 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:34:32.001785 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1a7b4b46-6555-4159-b5d6-9fa8a9b2a336 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:32.002937 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1a7b4b46-6555-4159-b5d6-9fa8a9b2a336 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:32.010803 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1a7b4b46-6555-4159-b5d6-9fa8a9b2a336 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:32.011278 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1a7b4b46-6555-4159-b5d6-9fa8a9b2a336 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:32.012065 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1a7b4b46-6555-4159-b5d6-9fa8a9b2a336 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:32.012493 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1a7b4b46-6555-4159-b5d6-9fa8a9b2a336 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:32.114827 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1a7b4b46-6555-4159-b5d6-9fa8a9b2a336 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 28241 microversion: 2.20 time: 0.117975 Dec 20 03:34:32.115466 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 407/798] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:31 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 28241 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:32.943290 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ecf1f411-4da9-424b-990f-a8629ff02316 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:32.944435 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ecf1f411-4da9-424b-990f-a8629ff02316 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:32.952702 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ecf1f411-4da9-424b-990f-a8629ff02316 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:32.953216 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ecf1f411-4da9-424b-990f-a8629ff02316 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:32.954031 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ecf1f411-4da9-424b-990f-a8629ff02316 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:32.954468 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ecf1f411-4da9-424b-990f-a8629ff02316 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:33.047982 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ecf1f411-4da9-424b-990f-a8629ff02316 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 38187 microversion: 2.1 time: 0.108541 Dec 20 03:34:33.053541 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 392/799] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:32 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 38187 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:34:33.128213 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0addfeb0-7543-4ce6-af7b-719059589f48 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:33.129385 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-0addfeb0-7543-4ce6-af7b-719059589f48 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:33.136282 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0addfeb0-7543-4ce6-af7b-719059589f48 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:33.136742 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0addfeb0-7543-4ce6-af7b-719059589f48 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:33.137575 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0addfeb0-7543-4ce6-af7b-719059589f48 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:33.138180 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0addfeb0-7543-4ce6-af7b-719059589f48 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:33.240494 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-0addfeb0-7543-4ce6-af7b-719059589f48 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 28500 microversion: 2.20 time: 0.117003 Dec 20 03:34:33.241404 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 408/800] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:33 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 28500 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 03:34:34.062466 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c74d3813-8648-4ee3-8af0-93db36ae1be6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:34.063504 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c74d3813-8648-4ee3-8af0-93db36ae1be6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:34.071622 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c74d3813-8648-4ee3-8af0-93db36ae1be6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:34.072134 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c74d3813-8648-4ee3-8af0-93db36ae1be6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:34.072942 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c74d3813-8648-4ee3-8af0-93db36ae1be6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:34.073411 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c74d3813-8648-4ee3-8af0-93db36ae1be6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:34.163963 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c74d3813-8648-4ee3-8af0-93db36ae1be6 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 38187 microversion: 2.1 time: 0.107249 Dec 20 03:34:34.168339 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 393/801] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:34 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 38187 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:34:34.259878 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f0b22620-fcc1-498b-b111-7c0c007dd732 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:34.262364 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-f0b22620-fcc1-498b-b111-7c0c007dd732 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:34.281196 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f0b22620-fcc1-498b-b111-7c0c007dd732 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:34.281953 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f0b22620-fcc1-498b-b111-7c0c007dd732 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:34.282851 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f0b22620-fcc1-498b-b111-7c0c007dd732 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:34.283475 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f0b22620-fcc1-498b-b111-7c0c007dd732 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:34.397950 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f0b22620-fcc1-498b-b111-7c0c007dd732 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 28668 microversion: 2.20 time: 0.145282 Dec 20 03:34:34.399287 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 409/802] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:34 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 28668 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:35.183025 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-78271f76-9ab7-4dcf-9956-b2c889711e49 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:35.185983 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-78271f76-9ab7-4dcf-9956-b2c889711e49 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:35.194209 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-78271f76-9ab7-4dcf-9956-b2c889711e49 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:35.194661 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-78271f76-9ab7-4dcf-9956-b2c889711e49 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:35.195748 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-78271f76-9ab7-4dcf-9956-b2c889711e49 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:35.196233 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-78271f76-9ab7-4dcf-9956-b2c889711e49 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:35.307766 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-78271f76-9ab7-4dcf-9956-b2c889711e49 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 38187 microversion: 2.1 time: 0.133706 Dec 20 03:34:35.309039 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 394/803] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:35 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 38187 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:34:35.414384 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e56da938-c819-4336-8837-46f5971df69a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:35.417611 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e56da938-c819-4336-8837-46f5971df69a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:35.427347 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e56da938-c819-4336-8837-46f5971df69a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:35.428342 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e56da938-c819-4336-8837-46f5971df69a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:35.429538 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e56da938-c819-4336-8837-46f5971df69a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:35.429993 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e56da938-c819-4336-8837-46f5971df69a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:35.540465 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e56da938-c819-4336-8837-46f5971df69a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 28668 microversion: 2.20 time: 0.133208 Dec 20 03:34:35.541389 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 410/804] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:35 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 28668 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:36.329545 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-b93e8493-ecc9-4070-a55b-6e7e099e13d9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:36.329545 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-b93e8493-ecc9-4070-a55b-6e7e099e13d9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:36.370908 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b93e8493-ecc9-4070-a55b-6e7e099e13d9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:36.370908 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b93e8493-ecc9-4070-a55b-6e7e099e13d9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:36.370908 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b93e8493-ecc9-4070-a55b-6e7e099e13d9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:36.370908 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b93e8493-ecc9-4070-a55b-6e7e099e13d9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:36.488930 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-b93e8493-ecc9-4070-a55b-6e7e099e13d9 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action" status: 200 len: 38318 microversion: 2.1 time: 0.172003 Dec 20 03:34:36.490381 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 395/805] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:34:36 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/action => generated 38318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:34:36.518574 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-5c5bae54-818d-4dc7-9b79-fff7e35823d2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:36.519595 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-5c5bae54-818d-4dc7-9b79-fff7e35823d2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:36.540226 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5c5bae54-818d-4dc7-9b79-fff7e35823d2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:36.540820 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5c5bae54-818d-4dc7-9b79-fff7e35823d2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:36.542064 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5c5bae54-818d-4dc7-9b79-fff7e35823d2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:36.542710 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5c5bae54-818d-4dc7-9b79-fff7e35823d2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:36.553670 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-26b16537-8325-42bb-aa96-f7ebaea196b5 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:36.556062 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-26b16537-8325-42bb-aa96-f7ebaea196b5 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:36.574283 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-26b16537-8325-42bb-aa96-f7ebaea196b5 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:36.574867 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-26b16537-8325-42bb-aa96-f7ebaea196b5 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:36.576851 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-26b16537-8325-42bb-aa96-f7ebaea196b5 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:36.578562 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-26b16537-8325-42bb-aa96-f7ebaea196b5 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:36.618954 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-5c5bae54-818d-4dc7-9b79-fff7e35823d2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/ips" status: 200 len: 147 microversion: 2.1 time: 0.118890 Dec 20 03:34:36.619787 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 411/806] 10.222.0.53 () {58 vars in 1247 bytes} [Mon Dec 20 03:34:36 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/ips => generated 147 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:34:36.707605 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-26b16537-8325-42bb-aa96-f7ebaea196b5 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 28668 microversion: 2.20 time: 0.157671 Dec 20 03:34:36.708876 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 396/807] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:36 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 28668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:37.720595 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-705b1c1b-8f3b-43df-bbf9-ce13138d2ced tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:37.721636 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-705b1c1b-8f3b-43df-bbf9-ce13138d2ced tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:37.729491 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-705b1c1b-8f3b-43df-bbf9-ce13138d2ced tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:37.730032 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-705b1c1b-8f3b-43df-bbf9-ce13138d2ced tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:37.730953 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-705b1c1b-8f3b-43df-bbf9-ce13138d2ced tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:37.731464 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-705b1c1b-8f3b-43df-bbf9-ce13138d2ced tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:37.830965 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-705b1c1b-8f3b-43df-bbf9-ce13138d2ced tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 29849 microversion: 2.20 time: 0.114594 Dec 20 03:34:37.831619 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 412/808] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:37 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 29849 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:38.685975 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f8d0106f-ac6d-494a-825b-3b4468cd3bb8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0ab9ad1-cc44-4c8b-95ee-e34edd9423bd"}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:38.691082 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f8d0106f-ac6d-494a-825b-3b4468cd3bb8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:38.703871 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f8d0106f-ac6d-494a-825b-3b4468cd3bb8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:38.704899 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f8d0106f-ac6d-494a-825b-3b4468cd3bb8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:38.706842 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f8d0106f-ac6d-494a-825b-3b4468cd3bb8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:38.708393 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f8d0106f-ac6d-494a-825b-3b4468cd3bb8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:38.844549 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-2186a271-b1de-42ef-980a-9f54293747b7 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:38.846321 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-2186a271-b1de-42ef-980a-9f54293747b7 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:38.854049 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2186a271-b1de-42ef-980a-9f54293747b7 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:38.854799 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2186a271-b1de-42ef-980a-9f54293747b7 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:38.862858 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2186a271-b1de-42ef-980a-9f54293747b7 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:38.865811 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2186a271-b1de-42ef-980a-9f54293747b7 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:38.987621 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-2186a271-b1de-42ef-980a-9f54293747b7 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 32078 microversion: 2.20 time: 0.148307 Dec 20 03:34:38.989847 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 413/809] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:38 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 32078 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:39.675368 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f8d0106f-ac6d-494a-825b-3b4468cd3bb8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.995998 Dec 20 03:34:39.676802 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 397/810] 10.222.0.53 () {60 vars in 1322 bytes} [Mon Dec 20 03:34:38 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments => generated 194 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:34:40.030227 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-c8165720-ed48-432c-bf9a-b995b4cb6522 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:40.030227 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-c8165720-ed48-432c-bf9a-b995b4cb6522 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:40.054020 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c8165720-ed48-432c-bf9a-b995b4cb6522 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:40.054808 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c8165720-ed48-432c-bf9a-b995b4cb6522 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:40.057898 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c8165720-ed48-432c-bf9a-b995b4cb6522 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:40.059418 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c8165720-ed48-432c-bf9a-b995b4cb6522 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:40.197126 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-c8165720-ed48-432c-bf9a-b995b4cb6522 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 33360 microversion: 2.20 time: 0.196585 Dec 20 03:34:40.198447 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 414/811] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:39 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 33360 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:41.211732 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-730d197d-ed94-4dec-80bc-51c82c4c18ec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:41.213091 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-730d197d-ed94-4dec-80bc-51c82c4c18ec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:41.233821 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-730d197d-ed94-4dec-80bc-51c82c4c18ec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:41.234176 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-730d197d-ed94-4dec-80bc-51c82c4c18ec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:41.235071 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-730d197d-ed94-4dec-80bc-51c82c4c18ec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:41.235575 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-730d197d-ed94-4dec-80bc-51c82c4c18ec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:41.365728 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-730d197d-ed94-4dec-80bc-51c82c4c18ec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 34193 microversion: 2.20 time: 0.158539 Dec 20 03:34:41.366722 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 398/812] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:41 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 34193 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:42.381705 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-38d3ec74-7eb2-43f2-9ce3-1196f55093b3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:42.383497 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-38d3ec74-7eb2-43f2-9ce3-1196f55093b3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:42.392268 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-38d3ec74-7eb2-43f2-9ce3-1196f55093b3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:42.393021 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-38d3ec74-7eb2-43f2-9ce3-1196f55093b3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:42.394094 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-38d3ec74-7eb2-43f2-9ce3-1196f55093b3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:42.394863 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-38d3ec74-7eb2-43f2-9ce3-1196f55093b3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:42.526657 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-38d3ec74-7eb2-43f2-9ce3-1196f55093b3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 35340 microversion: 2.20 time: 0.149333 Dec 20 03:34:42.529386 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 415/813] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:42 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 35340 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:43.540781 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ca8d5bf3-76ee-4d53-8229-009905399d4e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:43.541800 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ca8d5bf3-76ee-4d53-8229-009905399d4e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:43.549782 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ca8d5bf3-76ee-4d53-8229-009905399d4e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:43.550224 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ca8d5bf3-76ee-4d53-8229-009905399d4e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:43.551025 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ca8d5bf3-76ee-4d53-8229-009905399d4e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:43.551466 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ca8d5bf3-76ee-4d53-8229-009905399d4e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:43.670891 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ca8d5bf3-76ee-4d53-8229-009905399d4e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 36854 microversion: 2.20 time: 0.134038 Dec 20 03:34:43.671549 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 399/814] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:43 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 36854 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:44.685069 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-150fc459-cfab-4fd2-b521-2c804ef7fcef tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:44.687057 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-150fc459-cfab-4fd2-b521-2c804ef7fcef tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:44.694871 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-150fc459-cfab-4fd2-b521-2c804ef7fcef tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:44.695597 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-150fc459-cfab-4fd2-b521-2c804ef7fcef tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:44.696661 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-150fc459-cfab-4fd2-b521-2c804ef7fcef tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:44.697359 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-150fc459-cfab-4fd2-b521-2c804ef7fcef tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:44.801280 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-150fc459-cfab-4fd2-b521-2c804ef7fcef tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 38219 microversion: 2.20 time: 0.121281 Dec 20 03:34:44.802809 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 416/815] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:44 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 38219 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:45.033359 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-b42cb1ed-d1de-4b93-9ace-c34fc8bae9a0 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Action: 'create', calling method: .version_select at 0x7f49040dd040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-832830598"}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:45.053657 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-b42cb1ed-d1de-4b93-9ace-c34fc8bae9a0 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Getting quotas for project d4fa0cffd767432cae1c69fa4e26e6c5. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:34:45.060807 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-b42cb1ed-d1de-4b93-9ace-c34fc8bae9a0 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Getting quotas for user 0a13354364b2443cb3ba387ec4893d67 and project d4fa0cffd767432cae1c69fa4e26e6c5. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:34:45.329688 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-b42cb1ed-d1de-4b93-9ace-c34fc8bae9a0 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Getting quotas for project d4fa0cffd767432cae1c69fa4e26e6c5. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:34:45.335461 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-b42cb1ed-d1de-4b93-9ace-c34fc8bae9a0 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Getting quotas for user 0a13354364b2443cb3ba387ec4893d67 and project d4fa0cffd767432cae1c69fa4e26e6c5. Resources: {'key_pairs'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:34:45.351506 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-b42cb1ed-d1de-4b93-9ace-c34fc8bae9a0 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.538806 Dec 20 03:34:45.352187 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 400/816] 10.222.0.53 () {60 vars in 1157 bytes} [Mon Dec 20 03:34:44 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:34:45.815521 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-50018692-81e0-4297-bade-d4d5ba513234 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:45.816524 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-50018692-81e0-4297-bade-d4d5ba513234 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:45.823567 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-50018692-81e0-4297-bade-d4d5ba513234 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:45.824016 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-50018692-81e0-4297-bade-d4d5ba513234 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:45.824795 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-50018692-81e0-4297-bade-d4d5ba513234 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:45.825257 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-50018692-81e0-4297-bade-d4d5ba513234 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:45.922177 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-50018692-81e0-4297-bade-d4d5ba513234 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 38219 microversion: 2.20 time: 0.111255 Dec 20 03:34:45.923425 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 417/817] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:45 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 38219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:46.958859 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-3694c85c-e426-4f60-8c72-206687669fd3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:46.958859 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-3694c85c-e426-4f60-8c72-206687669fd3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:46.958859 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3694c85c-e426-4f60-8c72-206687669fd3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:46.958859 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3694c85c-e426-4f60-8c72-206687669fd3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:46.960815 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3694c85c-e426-4f60-8c72-206687669fd3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:46.960815 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3694c85c-e426-4f60-8c72-206687669fd3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:47.053005 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-3694c85c-e426-4f60-8c72-206687669fd3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 38219 microversion: 2.20 time: 0.121982 Dec 20 03:34:47.054197 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 401/818] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:46 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 38219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:48.071291 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-aa538af7-f610-4bdf-a71a-3d84f39be9d6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:48.073161 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-aa538af7-f610-4bdf-a71a-3d84f39be9d6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:48.085108 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-aa538af7-f610-4bdf-a71a-3d84f39be9d6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:48.086020 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-aa538af7-f610-4bdf-a71a-3d84f39be9d6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:48.087328 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-aa538af7-f610-4bdf-a71a-3d84f39be9d6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:48.088186 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-aa538af7-f610-4bdf-a71a-3d84f39be9d6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:48.193176 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-aa538af7-f610-4bdf-a71a-3d84f39be9d6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 38219 microversion: 2.20 time: 0.128101 Dec 20 03:34:48.194562 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 418/819] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:48 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 38219 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:48.440612 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-51ce10fa-1a98-492b-8d71-aa625825045a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:48.443680 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-51ce10fa-1a98-492b-8d71-aa625825045a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:48.458781 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-51ce10fa-1a98-492b-8d71-aa625825045a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:48.460141 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-51ce10fa-1a98-492b-8d71-aa625825045a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:48.461796 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-51ce10fa-1a98-492b-8d71-aa625825045a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:48.462581 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-51ce10fa-1a98-492b-8d71-aa625825045a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:48.536547 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-51ce10fa-1a98-492b-8d71-aa625825045a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103305 Dec 20 03:34:48.548371 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 402/820] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:34:48 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:34:48.558614 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-fc26133e-b8f9-45e3-aad6-a7dfb910d209 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:48.559474 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-fc26133e-b8f9-45e3-aad6-a7dfb910d209 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:48.576410 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fc26133e-b8f9-45e3-aad6-a7dfb910d209 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:48.577163 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fc26133e-b8f9-45e3-aad6-a7dfb910d209 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:48.578637 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fc26133e-b8f9-45e3-aad6-a7dfb910d209 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:48.579739 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fc26133e-b8f9-45e3-aad6-a7dfb910d209 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:48.635468 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-fc26133e-b8f9-45e3-aad6-a7dfb910d209 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments/b0ab9ad1-cc44-4c8b-95ee-e34edd9423bd" status: 200 len: 194 microversion: 2.1 time: 0.085685 Dec 20 03:34:48.637418 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 419/821] 10.222.0.53 () {58 vars in 1412 bytes} [Mon Dec 20 03:34:48 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments/b0ab9ad1-cc44-4c8b-95ee-e34edd9423bd => generated 194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:34:49.210281 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-50553d1e-1450-40b3-bd30-6d8ac875347e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:49.211120 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-50553d1e-1450-40b3-bd30-6d8ac875347e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:49.218206 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-50553d1e-1450-40b3-bd30-6d8ac875347e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:49.218659 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-50553d1e-1450-40b3-bd30-6d8ac875347e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:49.219515 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-50553d1e-1450-40b3-bd30-6d8ac875347e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:49.219952 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-50553d1e-1450-40b3-bd30-6d8ac875347e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:49.334202 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-50553d1e-1450-40b3-bd30-6d8ac875347e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 200 len: 38360 microversion: 2.20 time: 0.129754 Dec 20 03:34:49.335335 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 403/822] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:49 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 38360 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:34:49.351075 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-85e05f4e-2d0a-4c90-8c31-2cefe6adc58d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:49.353369 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-85e05f4e-2d0a-4c90-8c31-2cefe6adc58d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:49.361851 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-85e05f4e-2d0a-4c90-8c31-2cefe6adc58d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:49.362806 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-85e05f4e-2d0a-4c90-8c31-2cefe6adc58d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:49.364771 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-85e05f4e-2d0a-4c90-8c31-2cefe6adc58d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:49.365599 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-85e05f4e-2d0a-4c90-8c31-2cefe6adc58d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:49.405578 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-85e05f4e-2d0a-4c90-8c31-2cefe6adc58d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/ips" status: 200 len: 152 microversion: 2.20 time: 0.061740 Dec 20 03:34:49.424102 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 420/823] 10.222.0.53 () {60 vars in 1288 bytes} [Mon Dec 20 03:34:49 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/ips => generated 152 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:34:50.552230 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-6fb4d5d0-d0b2-4409-951b-ab08162e2c45 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d12c1ac1-f73b-404f-9194-da6dbce621e3"}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:50.553678 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6fb4d5d0-d0b2-4409-951b-ab08162e2c45 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:50.562538 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6fb4d5d0-d0b2-4409-951b-ab08162e2c45 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:50.563095 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6fb4d5d0-d0b2-4409-951b-ab08162e2c45 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:50.564295 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6fb4d5d0-d0b2-4409-951b-ab08162e2c45 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:50.564811 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6fb4d5d0-d0b2-4409-951b-ab08162e2c45 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:51.496209 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-6fb4d5d0-d0b2-4409-951b-ab08162e2c45 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.947844 Dec 20 03:34:51.496789 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 404/824] 10.222.0.53 () {60 vars in 1322 bytes} [Mon Dec 20 03:34:50 2021] POST /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments => generated 194 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:34:52.048996 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a9d18eba-0077-44c5-bfeb-ffa12dfa0d16 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:34:52.049591 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a9d18eba-0077-44c5-bfeb-ffa12dfa0d16 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:52.055840 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a9d18eba-0077-44c5-bfeb-ffa12dfa0d16 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:52.056293 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a9d18eba-0077-44c5-bfeb-ffa12dfa0d16 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:52.062502 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a9d18eba-0077-44c5-bfeb-ffa12dfa0d16 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:52.062502 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a9d18eba-0077-44c5-bfeb-ffa12dfa0d16 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:52.080894 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.objects.instance [None req-a9d18eba-0077-44c5-bfeb-ffa12dfa0d16 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lazy-loading 'flavor' on Instance uuid 4a1645c1-a90b-406b-ba58-0620598ecf89 {{(pid=117011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:34:52.748749 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a9d18eba-0077-44c5-bfeb-ffa12dfa0d16 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 202 len: 0 microversion: 2.20 time: 0.698295 Dec 20 03:34:52.748749 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 421/825] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:34:52 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 0 bytes in 700 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:34:52.754022 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d50260b3-9a8d-4ec4-8e92-12373476af27 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:52.754750 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d50260b3-9a8d-4ec4-8e92-12373476af27 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:52.760851 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d50260b3-9a8d-4ec4-8e92-12373476af27 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:52.761607 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d50260b3-9a8d-4ec4-8e92-12373476af27 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:52.762425 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d50260b3-9a8d-4ec4-8e92-12373476af27 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:52.762860 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d50260b3-9a8d-4ec4-8e92-12373476af27 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:52.907832 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d50260b3-9a8d-4ec4-8e92-12373476af27 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:52.915672 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d50260b3-9a8d-4ec4-8e92-12373476af27 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:52.917228 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d50260b3-9a8d-4ec4-8e92-12373476af27 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:52.918416 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d50260b3-9a8d-4ec4-8e92-12373476af27 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1723 microversion: 2.20 time: 0.170282 Dec 20 03:34:52.918979 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 405/826] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:34:52 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:34:53.938783 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-eba0886b-ebc7-4c69-9bbb-351e4c37b100 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:53.939475 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-eba0886b-ebc7-4c69-9bbb-351e4c37b100 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:53.946918 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eba0886b-ebc7-4c69-9bbb-351e4c37b100 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:53.947426 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eba0886b-ebc7-4c69-9bbb-351e4c37b100 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:53.948257 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eba0886b-ebc7-4c69-9bbb-351e4c37b100 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:53.948700 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eba0886b-ebc7-4c69-9bbb-351e4c37b100 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:54.085694 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-eba0886b-ebc7-4c69-9bbb-351e4c37b100 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:54.096005 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-eba0886b-ebc7-4c69-9bbb-351e4c37b100 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:54.097557 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-eba0886b-ebc7-4c69-9bbb-351e4c37b100 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:54.098861 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-eba0886b-ebc7-4c69-9bbb-351e4c37b100 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1723 microversion: 2.20 time: 0.164607 Dec 20 03:34:54.099476 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 422/827] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:34:53 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:34:55.118167 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-fc9a28fd-1efa-4e0c-9649-202ca98ffebb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:55.121756 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-fc9a28fd-1efa-4e0c-9649-202ca98ffebb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:55.125988 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fc9a28fd-1efa-4e0c-9649-202ca98ffebb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:55.130872 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fc9a28fd-1efa-4e0c-9649-202ca98ffebb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:55.130872 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fc9a28fd-1efa-4e0c-9649-202ca98ffebb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:55.130872 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-fc9a28fd-1efa-4e0c-9649-202ca98ffebb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:55.273066 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-fc9a28fd-1efa-4e0c-9649-202ca98ffebb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:55.281894 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-fc9a28fd-1efa-4e0c-9649-202ca98ffebb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:55.283406 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-fc9a28fd-1efa-4e0c-9649-202ca98ffebb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:55.284614 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-fc9a28fd-1efa-4e0c-9649-202ca98ffebb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1723 microversion: 2.20 time: 0.171149 Dec 20 03:34:55.285194 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 406/828] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:34:55 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:34:56.303488 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-15ec6e99-7082-42ec-be91-22ce190177b8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:56.304109 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-15ec6e99-7082-42ec-be91-22ce190177b8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:56.312725 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-15ec6e99-7082-42ec-be91-22ce190177b8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:56.313216 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-15ec6e99-7082-42ec-be91-22ce190177b8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:56.314053 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-15ec6e99-7082-42ec-be91-22ce190177b8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:56.314492 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-15ec6e99-7082-42ec-be91-22ce190177b8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:56.462347 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-15ec6e99-7082-42ec-be91-22ce190177b8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:56.471687 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-15ec6e99-7082-42ec-be91-22ce190177b8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:56.473552 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-15ec6e99-7082-42ec-be91-22ce190177b8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:56.474703 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-15ec6e99-7082-42ec-be91-22ce190177b8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1723 microversion: 2.20 time: 0.175331 Dec 20 03:34:56.475264 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 423/829] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:34:56 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:34:57.500484 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-4f6c35d9-661c-4330-8df9-12157de66b81 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:57.501090 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-4f6c35d9-661c-4330-8df9-12157de66b81 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:57.507441 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4f6c35d9-661c-4330-8df9-12157de66b81 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:57.507892 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4f6c35d9-661c-4330-8df9-12157de66b81 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:57.508669 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4f6c35d9-661c-4330-8df9-12157de66b81 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:57.509107 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4f6c35d9-661c-4330-8df9-12157de66b81 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:57.649832 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-4f6c35d9-661c-4330-8df9-12157de66b81 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:57.658126 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-4f6c35d9-661c-4330-8df9-12157de66b81 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:57.659669 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-4f6c35d9-661c-4330-8df9-12157de66b81 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:57.660819 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-4f6c35d9-661c-4330-8df9-12157de66b81 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1723 microversion: 2.20 time: 0.164890 Dec 20 03:34:57.661401 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 407/830] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:34:57 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:34:58.679300 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-4293e25e-4028-469b-a194-f58141b22014 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:58.679897 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-4293e25e-4028-469b-a194-f58141b22014 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:58.686689 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4293e25e-4028-469b-a194-f58141b22014 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:58.687126 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4293e25e-4028-469b-a194-f58141b22014 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:58.687893 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4293e25e-4028-469b-a194-f58141b22014 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:58.688321 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4293e25e-4028-469b-a194-f58141b22014 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:58.821018 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-4293e25e-4028-469b-a194-f58141b22014 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:58.830364 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-4293e25e-4028-469b-a194-f58141b22014 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:58.832153 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-4293e25e-4028-469b-a194-f58141b22014 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:34:58.833397 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-4293e25e-4028-469b-a194-f58141b22014 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1723 microversion: 2.20 time: 0.157662 Dec 20 03:34:58.835579 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 424/831] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:34:58 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:34:59.853727 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c504a61e-fabd-4156-91b8-6f7948fac6ed tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:34:59.854345 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c504a61e-fabd-4156-91b8-6f7948fac6ed tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:34:59.861349 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c504a61e-fabd-4156-91b8-6f7948fac6ed tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:59.861806 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c504a61e-fabd-4156-91b8-6f7948fac6ed tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:59.862590 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c504a61e-fabd-4156-91b8-6f7948fac6ed tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:34:59.863041 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c504a61e-fabd-4156-91b8-6f7948fac6ed tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:34:59.994687 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c504a61e-fabd-4156-91b8-6f7948fac6ed tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:00.004572 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c504a61e-fabd-4156-91b8-6f7948fac6ed tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:00.006084 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c504a61e-fabd-4156-91b8-6f7948fac6ed tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:00.007241 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c504a61e-fabd-4156-91b8-6f7948fac6ed tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1723 microversion: 2.20 time: 0.157264 Dec 20 03:35:00.007794 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 408/832] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:34:59 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:35:00.041093 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e5569eef-adcc-47e4-8b08-e32edf7ca623 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:00.042095 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e5569eef-adcc-47e4-8b08-e32edf7ca623 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:00.050264 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e5569eef-adcc-47e4-8b08-e32edf7ca623 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:00.050704 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e5569eef-adcc-47e4-8b08-e32edf7ca623 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:00.051496 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e5569eef-adcc-47e4-8b08-e32edf7ca623 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:00.051924 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e5569eef-adcc-47e4-8b08-e32edf7ca623 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:00.083580 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e5569eef-adcc-47e4-8b08-e32edf7ca623 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046129 Dec 20 03:35:00.084126 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 425/833] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:35:00 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:35:00.319628 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-5427daef-9e7c-4987-9951-502db6a5c2cb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:00.320126 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-5427daef-9e7c-4987-9951-502db6a5c2cb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:00.326142 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5427daef-9e7c-4987-9951-502db6a5c2cb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:00.326975 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5427daef-9e7c-4987-9951-502db6a5c2cb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:00.327377 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5427daef-9e7c-4987-9951-502db6a5c2cb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:00.330429 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5427daef-9e7c-4987-9951-502db6a5c2cb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:00.360762 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-5427daef-9e7c-4987-9951-502db6a5c2cb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments/b0ab9ad1-cc44-4c8b-95ee-e34edd9423bd" status: 200 len: 194 microversion: 2.1 time: 0.044902 Dec 20 03:35:00.361405 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 409/834] 10.222.0.53 () {58 vars in 1412 bytes} [Mon Dec 20 03:35:00 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments/b0ab9ad1-cc44-4c8b-95ee-e34edd9423bd => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:35:00.370870 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1e1753c1-8109-4c1d-ac91-dc73576f4ac4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:00.371359 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1e1753c1-8109-4c1d-ac91-dc73576f4ac4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:00.382289 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1e1753c1-8109-4c1d-ac91-dc73576f4ac4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:00.382289 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1e1753c1-8109-4c1d-ac91-dc73576f4ac4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:00.382289 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1e1753c1-8109-4c1d-ac91-dc73576f4ac4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:00.382289 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1e1753c1-8109-4c1d-ac91-dc73576f4ac4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:00.459444 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.objects.instance [None req-1e1753c1-8109-4c1d-ac91-dc73576f4ac4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lazy-loading 'services' on Instance uuid 4d0ea081-3dd8-40ec-bade-7fbf12f68c75 {{(pid=117011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:35:00.696984 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1e1753c1-8109-4c1d-ac91-dc73576f4ac4 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "DELETE /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments/b0ab9ad1-cc44-4c8b-95ee-e34edd9423bd" status: 202 len: 0 microversion: 2.1 time: 0.329634 Dec 20 03:35:00.697749 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 426/835] 10.222.0.53 () {58 vars in 1415 bytes} [Mon Dec 20 03:35:00 2021] DELETE /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments/b0ab9ad1-cc44-4c8b-95ee-e34edd9423bd => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:35:01.025594 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c102f736-ec49-459c-8928-d9fdee886900 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:01.026188 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c102f736-ec49-459c-8928-d9fdee886900 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:01.032773 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c102f736-ec49-459c-8928-d9fdee886900 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:01.033320 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c102f736-ec49-459c-8928-d9fdee886900 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:01.034100 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c102f736-ec49-459c-8928-d9fdee886900 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:01.034551 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c102f736-ec49-459c-8928-d9fdee886900 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:01.170295 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c102f736-ec49-459c-8928-d9fdee886900 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:01.178350 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c102f736-ec49-459c-8928-d9fdee886900 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:01.179847 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c102f736-ec49-459c-8928-d9fdee886900 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:01.180992 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c102f736-ec49-459c-8928-d9fdee886900 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1723 microversion: 2.20 time: 0.159097 Dec 20 03:35:01.181588 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 410/836] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:01 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:02.200200 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-6556bbb5-8243-4d89-a9c5-edb1c253d87e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:02.200893 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6556bbb5-8243-4d89-a9c5-edb1c253d87e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:02.208190 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6556bbb5-8243-4d89-a9c5-edb1c253d87e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:02.208632 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6556bbb5-8243-4d89-a9c5-edb1c253d87e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:02.209439 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6556bbb5-8243-4d89-a9c5-edb1c253d87e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:02.209869 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6556bbb5-8243-4d89-a9c5-edb1c253d87e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:02.348896 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6556bbb5-8243-4d89-a9c5-edb1c253d87e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:02.357179 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6556bbb5-8243-4d89-a9c5-edb1c253d87e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:02.358710 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6556bbb5-8243-4d89-a9c5-edb1c253d87e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:02.359932 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-6556bbb5-8243-4d89-a9c5-edb1c253d87e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1723 microversion: 2.20 time: 0.164619 Dec 20 03:35:02.360485 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 427/837] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:02 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:02.861464 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7f121acd-b1cc-4d46-976a-e4c3d175f3ef tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:02.861967 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-7f121acd-b1cc-4d46-976a-e4c3d175f3ef tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:02.868432 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7f121acd-b1cc-4d46-976a-e4c3d175f3ef tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:02.868895 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7f121acd-b1cc-4d46-976a-e4c3d175f3ef tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:02.869712 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7f121acd-b1cc-4d46-976a-e4c3d175f3ef tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:02.870151 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7f121acd-b1cc-4d46-976a-e4c3d175f3ef tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:02.900799 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7f121acd-b1cc-4d46-976a-e4c3d175f3ef tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments/d12c1ac1-f73b-404f-9194-da6dbce621e3" status: 200 len: 194 microversion: 2.1 time: 0.043530 Dec 20 03:35:02.901421 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 411/838] 10.222.0.53 () {58 vars in 1412 bytes} [Mon Dec 20 03:35:02 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments/d12c1ac1-f73b-404f-9194-da6dbce621e3 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:35:02.911001 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e9a68203-5e1c-4f33-bc85-36195160fced tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:02.911493 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e9a68203-5e1c-4f33-bc85-36195160fced tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:02.917275 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e9a68203-5e1c-4f33-bc85-36195160fced tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:02.917730 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e9a68203-5e1c-4f33-bc85-36195160fced tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:02.918494 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e9a68203-5e1c-4f33-bc85-36195160fced tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:02.918928 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e9a68203-5e1c-4f33-bc85-36195160fced tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:02.996665 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.objects.instance [None req-e9a68203-5e1c-4f33-bc85-36195160fced tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lazy-loading 'services' on Instance uuid 4d0ea081-3dd8-40ec-bade-7fbf12f68c75 {{(pid=117011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:35:03.240156 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e9a68203-5e1c-4f33-bc85-36195160fced tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "DELETE /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments/d12c1ac1-f73b-404f-9194-da6dbce621e3" status: 202 len: 0 microversion: 2.1 time: 0.332670 Dec 20 03:35:03.240938 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 428/839] 10.222.0.53 () {58 vars in 1415 bytes} [Mon Dec 20 03:35:02 2021] DELETE /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments/d12c1ac1-f73b-404f-9194-da6dbce621e3 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:35:03.378088 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-0b4ce143-104a-474c-b891-6077497e2521 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:03.378695 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-0b4ce143-104a-474c-b891-6077497e2521 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:03.384668 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0b4ce143-104a-474c-b891-6077497e2521 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:03.385250 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0b4ce143-104a-474c-b891-6077497e2521 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:03.386060 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0b4ce143-104a-474c-b891-6077497e2521 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:03.386615 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0b4ce143-104a-474c-b891-6077497e2521 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:03.519176 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0b4ce143-104a-474c-b891-6077497e2521 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:03.527356 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0b4ce143-104a-474c-b891-6077497e2521 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:03.528853 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0b4ce143-104a-474c-b891-6077497e2521 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:03.530581 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-0b4ce143-104a-474c-b891-6077497e2521 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1723 microversion: 2.20 time: 0.156888 Dec 20 03:35:03.531154 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 412/840] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:03 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:04.549775 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-6d8f1a52-a466-4121-b897-2d1fdb2181aa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:04.550466 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6d8f1a52-a466-4121-b897-2d1fdb2181aa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:04.556646 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6d8f1a52-a466-4121-b897-2d1fdb2181aa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:04.557072 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6d8f1a52-a466-4121-b897-2d1fdb2181aa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:04.557876 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6d8f1a52-a466-4121-b897-2d1fdb2181aa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:04.558336 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6d8f1a52-a466-4121-b897-2d1fdb2181aa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:04.709324 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6d8f1a52-a466-4121-b897-2d1fdb2181aa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:04.718022 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6d8f1a52-a466-4121-b897-2d1fdb2181aa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:04.719514 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6d8f1a52-a466-4121-b897-2d1fdb2181aa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:04.720663 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-6d8f1a52-a466-4121-b897-2d1fdb2181aa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1744 microversion: 2.20 time: 0.176167 Dec 20 03:35:04.721235 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 429/841] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:04 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:05.447474 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-361d1884-7f70-408e-8ba8-1cefef956141 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:05.448444 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-361d1884-7f70-408e-8ba8-1cefef956141 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:05.455837 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-361d1884-7f70-408e-8ba8-1cefef956141 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:05.456290 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-361d1884-7f70-408e-8ba8-1cefef956141 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:05.457065 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-361d1884-7f70-408e-8ba8-1cefef956141 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:05.457537 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-361d1884-7f70-408e-8ba8-1cefef956141 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:05.486820 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-361d1884-7f70-408e-8ba8-1cefef956141 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043034 Dec 20 03:35:05.487369 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 413/842] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:35:05 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 03:35:05.595018 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e525a740-fa8f-42f7-be9c-77e3c52b6d42 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:05.596019 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e525a740-fa8f-42f7-be9c-77e3c52b6d42 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:05.602535 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e525a740-fa8f-42f7-be9c-77e3c52b6d42 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:05.602916 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e525a740-fa8f-42f7-be9c-77e3c52b6d42 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:05.603717 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e525a740-fa8f-42f7-be9c-77e3c52b6d42 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:05.604153 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e525a740-fa8f-42f7-be9c-77e3c52b6d42 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:05.635287 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e525a740-fa8f-42f7-be9c-77e3c52b6d42 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044635 Dec 20 03:35:05.635851 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 430/843] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:35:05 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 03:35:05.702979 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-456fd0f3-be5d-43df-8074-2abf3438d07a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:05.703481 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-456fd0f3-be5d-43df-8074-2abf3438d07a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:05.709276 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-456fd0f3-be5d-43df-8074-2abf3438d07a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:05.709728 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-456fd0f3-be5d-43df-8074-2abf3438d07a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:05.710499 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-456fd0f3-be5d-43df-8074-2abf3438d07a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:05.710941 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-456fd0f3-be5d-43df-8074-2abf3438d07a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:05.739188 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-456fd0f3-be5d-43df-8074-2abf3438d07a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Going to try to terminate instance {{(pid=117012) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:35:05.739779 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-c30fc5d2-0c2b-40ec-a139-ff73c9fa66af tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:05.740526 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-c30fc5d2-0c2b-40ec-a139-ff73c9fa66af tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:05.747159 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c30fc5d2-0c2b-40ec-a139-ff73c9fa66af tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:05.747606 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c30fc5d2-0c2b-40ec-a139-ff73c9fa66af tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:05.748412 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c30fc5d2-0c2b-40ec-a139-ff73c9fa66af tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:05.749209 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c30fc5d2-0c2b-40ec-a139-ff73c9fa66af tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:05.889910 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-c30fc5d2-0c2b-40ec-a139-ff73c9fa66af tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:05.896408 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-c30fc5d2-0c2b-40ec-a139-ff73c9fa66af tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:05.897968 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-c30fc5d2-0c2b-40ec-a139-ff73c9fa66af tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:05.899122 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-c30fc5d2-0c2b-40ec-a139-ff73c9fa66af tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1739 microversion: 2.20 time: 0.163723 Dec 20 03:35:05.899672 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 431/844] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:05 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:06.046095 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-456fd0f3-be5d-43df-8074-2abf3438d07a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "DELETE /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 204 len: 0 microversion: 2.1 time: 0.352825 Dec 20 03:35:06.046752 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 414/845] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:35:05 2021] DELETE /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:35:06.054788 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-8a8c2e6e-68dd-4c9f-b274-50cb9dd07f36 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:06.055403 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-8a8c2e6e-68dd-4c9f-b274-50cb9dd07f36 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:06.061592 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8a8c2e6e-68dd-4c9f-b274-50cb9dd07f36 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:06.063382 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8a8c2e6e-68dd-4c9f-b274-50cb9dd07f36 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:06.064257 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8a8c2e6e-68dd-4c9f-b274-50cb9dd07f36 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:06.064734 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8a8c2e6e-68dd-4c9f-b274-50cb9dd07f36 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:06.200810 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-8a8c2e6e-68dd-4c9f-b274-50cb9dd07f36 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:06.208496 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-8a8c2e6e-68dd-4c9f-b274-50cb9dd07f36 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 200 len: 1675 microversion: 2.1 time: 0.157348 Dec 20 03:35:06.210751 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 432/846] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:06 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:06.917502 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e18ec5b5-8f41-4fc9-ad35-55a9f5e47945 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:06.918436 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e18ec5b5-8f41-4fc9-ad35-55a9f5e47945 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:06.926255 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e18ec5b5-8f41-4fc9-ad35-55a9f5e47945 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:06.926825 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e18ec5b5-8f41-4fc9-ad35-55a9f5e47945 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:06.927766 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e18ec5b5-8f41-4fc9-ad35-55a9f5e47945 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:06.928316 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e18ec5b5-8f41-4fc9-ad35-55a9f5e47945 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:07.075308 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-e18ec5b5-8f41-4fc9-ad35-55a9f5e47945 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:07.084548 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-e18ec5b5-8f41-4fc9-ad35-55a9f5e47945 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:07.086306 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-e18ec5b5-8f41-4fc9-ad35-55a9f5e47945 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:07.087550 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e18ec5b5-8f41-4fc9-ad35-55a9f5e47945 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1739 microversion: 2.20 time: 0.174402 Dec 20 03:35:07.088610 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 415/847] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:06 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:07.225598 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ae0aac44-a1ff-40e0-afd2-c32a5a834fbb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:07.226199 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ae0aac44-a1ff-40e0-afd2-c32a5a834fbb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:07.238666 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ae0aac44-a1ff-40e0-afd2-c32a5a834fbb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:07.239116 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ae0aac44-a1ff-40e0-afd2-c32a5a834fbb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:07.239916 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ae0aac44-a1ff-40e0-afd2-c32a5a834fbb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:07.240358 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ae0aac44-a1ff-40e0-afd2-c32a5a834fbb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:07.372637 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-0d40f872-1d62-4a5b-8513-2147dff9be54 req-55906e05-72ac-4b54-bc6b-f42680f3874e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1645c1-a90b-406b-ba58-0620598ecf89", "name": "network-vif-plugged", "status": "completed", "tag": "31810791-54e6-413e-889b-510ef52f5b14"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:35:07.374997 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:35:07.374997 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:35:07.382041 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-0d40f872-1d62-4a5b-8513-2147dff9be54 req-55906e05-72ac-4b54-bc6b-f42680f3874e service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:07.382515 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-0d40f872-1d62-4a5b-8513-2147dff9be54 req-55906e05-72ac-4b54-bc6b-f42680f3874e service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:07.383905 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ae0aac44-a1ff-40e0-afd2-c32a5a834fbb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:07.392731 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ae0aac44-a1ff-40e0-afd2-c32a5a834fbb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 200 len: 1675 microversion: 2.1 time: 0.170632 Dec 20 03:35:07.402685 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 433/848] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:07 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:07.411728 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-0d40f872-1d62-4a5b-8513-2147dff9be54 req-55906e05-72ac-4b54-bc6b-f42680f3874e service nova] Creating event network-vif-plugged:31810791-54e6-413e-889b-510ef52f5b14 for instance 4a1645c1-a90b-406b-ba58-0620598ecf89 on hv-cinder-81803 Dec 20 03:35:07.417606 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-0d40f872-1d62-4a5b-8513-2147dff9be54 req-55906e05-72ac-4b54-bc6b-f42680f3874e service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117292 Dec 20 03:35:07.418239 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 416/849] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:35:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:35:08.106822 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-9f9d5020-1cb6-4035-aa3b-118ef5981077 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:08.107877 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-9f9d5020-1cb6-4035-aa3b-118ef5981077 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:08.114952 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9f9d5020-1cb6-4035-aa3b-118ef5981077 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:08.115909 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9f9d5020-1cb6-4035-aa3b-118ef5981077 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:08.116778 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9f9d5020-1cb6-4035-aa3b-118ef5981077 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:08.117313 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9f9d5020-1cb6-4035-aa3b-118ef5981077 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:08.291261 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9f9d5020-1cb6-4035-aa3b-118ef5981077 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:08.300153 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9f9d5020-1cb6-4035-aa3b-118ef5981077 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:08.303344 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9f9d5020-1cb6-4035-aa3b-118ef5981077 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:08.305100 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-9f9d5020-1cb6-4035-aa3b-118ef5981077 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1739 microversion: 2.20 time: 0.202271 Dec 20 03:35:08.305753 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 434/850] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:08 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:08.412890 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-12f13b4b-7b28-42d1-bf0b-3373f8dcd15d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:08.416227 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-12f13b4b-7b28-42d1-bf0b-3373f8dcd15d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:08.425326 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-12f13b4b-7b28-42d1-bf0b-3373f8dcd15d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:08.425786 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-12f13b4b-7b28-42d1-bf0b-3373f8dcd15d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:08.426630 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-12f13b4b-7b28-42d1-bf0b-3373f8dcd15d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:08.427104 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-12f13b4b-7b28-42d1-bf0b-3373f8dcd15d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:08.535632 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-debb0886-55b2-47b4-9c99-70d9e125589e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1528272423"}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:35:08.536179 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-debb0886-55b2-47b4-9c99-70d9e125589e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:08.542153 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-debb0886-55b2-47b4-9c99-70d9e125589e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:08.542851 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-debb0886-55b2-47b4-9c99-70d9e125589e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:08.543954 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-debb0886-55b2-47b4-9c99-70d9e125589e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:08.544560 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-debb0886-55b2-47b4-9c99-70d9e125589e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:08.726107 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-12f13b4b-7b28-42d1-bf0b-3373f8dcd15d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:08.734302 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-12f13b4b-7b28-42d1-bf0b-3373f8dcd15d tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 200 len: 1675 microversion: 2.1 time: 0.326148 Dec 20 03:35:08.747330 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 417/851] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:08 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 1675 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:08.804770 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.network.security_group_api [None req-debb0886-55b2-47b4-9c99-70d9e125589e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Removing security group 75465038-afa0-4bc4-8472-5ba4863afd0f from port 252e4b81-2b8b-4472-b0f9-0b2a9b974c88 Dec 20 03:35:09.324608 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-68a240f1-5db1-4d54-b671-61456d5a3327 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:09.325214 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-68a240f1-5db1-4d54-b671-61456d5a3327 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:09.352067 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-68a240f1-5db1-4d54-b671-61456d5a3327 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:09.352525 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-68a240f1-5db1-4d54-b671-61456d5a3327 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:09.353496 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-68a240f1-5db1-4d54-b671-61456d5a3327 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:09.356058 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-68a240f1-5db1-4d54-b671-61456d5a3327 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:09.542103 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-debb0886-55b2-47b4-9c99-70d9e125589e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "POST /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a/action" status: 202 len: 0 microversion: 2.1 time: 1.012789 Dec 20 03:35:09.542714 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 435/852] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:35:08 2021] POST /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a/action => generated 0 bytes in 1014 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:35:09.548005 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e543e904-7936-471f-a3e2-38d01222b20d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1480080961", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-832830598", "security_groups": [{"name": "tempest-secgroup-smoke-1005542187"}], "block_device_mapping_v2": [{"uuid": "8cfde632-fe6e-47f4-9132-290483e1cc86", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "247f1037-2c21-483f-b1d2-d9c7b96998be"}]}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:35:09.762082 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-68a240f1-5db1-4d54-b671-61456d5a3327 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:09.773499 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-68a240f1-5db1-4d54-b671-61456d5a3327 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:09.777924 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-68a240f1-5db1-4d54-b671-61456d5a3327 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:09.785545 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.network.neutron [None req-e543e904-7936-471f-a3e2-38d01222b20d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] validate_networks() for [('247f1037-2c21-483f-b1d2-d9c7b96998be', None, None, None, None, None)] {{(pid=117011) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:35:09.786753 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-68a240f1-5db1-4d54-b671-61456d5a3327 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1739 microversion: 2.20 time: 0.466586 Dec 20 03:35:09.790433 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 418/853] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:09 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1739 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:35:09.909122 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-4e150a3c-b521-4b5f-b600-16458bbae494 req-a67db2e2-b418-4f32-9525-44a553702c6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2dfd907-6eb9-4420-b9dc-36fa0518d29a", "tag": "252e4b81-2b8b-4472-b0f9-0b2a9b974c88"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:35:09.913103 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:35:09.913103 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:35:09.935480 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-4e150a3c-b521-4b5f-b600-16458bbae494 req-a67db2e2-b418-4f32-9525-44a553702c6b service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:09.936736 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-4e150a3c-b521-4b5f-b600-16458bbae494 req-a67db2e2-b418-4f32-9525-44a553702c6b service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:09.958867 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-4e150a3c-b521-4b5f-b600-16458bbae494 req-a67db2e2-b418-4f32-9525-44a553702c6b service nova] Creating event network-changed:252e4b81-2b8b-4472-b0f9-0b2a9b974c88 for instance d2dfd907-6eb9-4420-b9dc-36fa0518d29a on hv-cinder-81803 Dec 20 03:35:09.974138 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-4e150a3c-b521-4b5f-b600-16458bbae494 req-a67db2e2-b418-4f32-9525-44a553702c6b service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182351 Dec 20 03:35:09.975131 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 419/854] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:35:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:35:09.980499 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f14ac6bc-e968-4124-ba04-0127cf0a5063 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:09.981598 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f14ac6bc-e968-4124-ba04-0127cf0a5063 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:09.996560 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f14ac6bc-e968-4124-ba04-0127cf0a5063 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:09.997004 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f14ac6bc-e968-4124-ba04-0127cf0a5063 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:10.008983 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f14ac6bc-e968-4124-ba04-0127cf0a5063 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:10.009751 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f14ac6bc-e968-4124-ba04-0127cf0a5063 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:10.212479 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-f14ac6bc-e968-4124-ba04-0127cf0a5063 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:10.222840 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f14ac6bc-e968-4124-ba04-0127cf0a5063 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 200 len: 1607 microversion: 2.1 time: 0.246289 Dec 20 03:35:10.229193 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 420/855] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:09 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 1607 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:10.355959 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-0744bd30-5cda-4d98-a0ec-4e9b7ff1f0e1 req-2d5ea037-cdca-4079-9120-0325c36af552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d0ea081-3dd8-40ec-bade-7fbf12f68c75", "name": "network-vif-deleted", "tag": "0937f7e3-7e3d-4d63-8a16-585915a1cb83"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:35:10.357173 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:35:10.357173 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:35:10.373097 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-0744bd30-5cda-4d98-a0ec-4e9b7ff1f0e1 req-2d5ea037-cdca-4079-9120-0325c36af552 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:10.378733 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-0744bd30-5cda-4d98-a0ec-4e9b7ff1f0e1 req-2d5ea037-cdca-4079-9120-0325c36af552 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:10.434611 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-0744bd30-5cda-4d98-a0ec-4e9b7ff1f0e1 req-2d5ea037-cdca-4079-9120-0325c36af552 service nova] Creating event network-vif-deleted:0937f7e3-7e3d-4d63-8a16-585915a1cb83 for instance 4d0ea081-3dd8-40ec-bade-7fbf12f68c75 on hv-cinder-81803 Dec 20 03:35:10.444826 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-0744bd30-5cda-4d98-a0ec-4e9b7ff1f0e1 req-2d5ea037-cdca-4079-9120-0325c36af552 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183654 Dec 20 03:35:10.446809 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 421/856] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:35:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:35:10.759997 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-e543e904-7936-471f-a3e2-38d01222b20d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Flavor limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:35:10.760654 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-e543e904-7936-471f-a3e2-38d01222b20d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Image limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:35:10.760886 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-e543e904-7936-471f-a3e2-38d01222b20d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Flavor pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:35:10.761521 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-e543e904-7936-471f-a3e2-38d01222b20d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Image pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:35:10.765801 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-e543e904-7936-471f-a3e2-38d01222b20d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:35:10.783914 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e543e904-7936-471f-a3e2-38d01222b20d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:10.784373 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e543e904-7936-471f-a3e2-38d01222b20d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:10.785222 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e543e904-7936-471f-a3e2-38d01222b20d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:10.788138 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e543e904-7936-471f-a3e2-38d01222b20d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:10.807874 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-dc9d43ea-bbd9-42d0-9340-e13443af93fc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:10.808588 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-dc9d43ea-bbd9-42d0-9340-e13443af93fc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:10.831490 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dc9d43ea-bbd9-42d0-9340-e13443af93fc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:10.832046 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dc9d43ea-bbd9-42d0-9340-e13443af93fc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:10.838966 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-e543e904-7936-471f-a3e2-38d01222b20d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Getting quotas for project d4fa0cffd767432cae1c69fa4e26e6c5. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:35:10.846918 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-e543e904-7936-471f-a3e2-38d01222b20d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Getting quotas for user 0a13354364b2443cb3ba387ec4893d67 and project d4fa0cffd767432cae1c69fa4e26e6c5. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:35:10.855241 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dc9d43ea-bbd9-42d0-9340-e13443af93fc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:10.859096 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dc9d43ea-bbd9-42d0-9340-e13443af93fc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:10.927919 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e543e904-7936-471f-a3e2-38d01222b20d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Going to run 1 instances... {{(pid=117011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:35:10.930869 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e543e904-7936-471f-a3e2-38d01222b20d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8cfde632-fe6e-47f4-9132-290483e1cc86',volume_size=None,volume_type=None)] {{(pid=117011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:35:11.282684 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-dc9d43ea-bbd9-42d0-9340-e13443af93fc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:11.290729 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-dc9d43ea-bbd9-42d0-9340-e13443af93fc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:11.292880 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-dc9d43ea-bbd9-42d0-9340-e13443af93fc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:11.294205 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-dc9d43ea-bbd9-42d0-9340-e13443af93fc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1739 microversion: 2.20 time: 0.491269 Dec 20 03:35:11.295125 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 422/857] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:10 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1739 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:11.300712 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-738b4c82-74de-426f-816e-beb4db23a7d3 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:11.301099 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-738b4c82-74de-426f-816e-beb4db23a7d3 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:11.311868 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-738b4c82-74de-426f-816e-beb4db23a7d3 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:11.312706 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-738b4c82-74de-426f-816e-beb4db23a7d3 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:11.313732 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-738b4c82-74de-426f-816e-beb4db23a7d3 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:11.314172 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-738b4c82-74de-426f-816e-beb4db23a7d3 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:11.365509 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-738b4c82-74de-426f-816e-beb4db23a7d3 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:11.365509 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-738b4c82-74de-426f-816e-beb4db23a7d3 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:11.365509 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.objects.instance [None req-738b4c82-74de-426f-816e-beb4db23a7d3 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lazy-loading 'fault' on Instance uuid 4d0ea081-3dd8-40ec-bade-7fbf12f68c75 {{(pid=117012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:35:11.482010 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-738b4c82-74de-426f-816e-beb4db23a7d3 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb957bae32453189561ef619aaf88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6cedc6984fc42c8a1f5b20ec5354095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:11.497460 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-738b4c82-74de-426f-816e-beb4db23a7d3 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 200 len: 1327 microversion: 2.1 time: 0.200109 Dec 20 03:35:11.499373 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 423/858] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:11 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 1327 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:12.017387 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e543e904-7936-471f-a3e2-38d01222b20d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.472962 Dec 20 03:35:12.019697 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 436/859] 10.222.0.53 () {60 vars in 1146 bytes} [Mon Dec 20 03:35:09 2021] POST /compute/v2.1/servers => generated 406 bytes in 2476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 03:35:12.035247 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a7d6cbbc-ac5f-4e37-b759-5e86fb4bf2e0 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:12.036402 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a7d6cbbc-ac5f-4e37-b759-5e86fb4bf2e0 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:12.146154 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-a7d6cbbc-ac5f-4e37-b759-5e86fb4bf2e0 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:12.162369 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a7d6cbbc-ac5f-4e37-b759-5e86fb4bf2e0 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1094 microversion: 2.1 time: 0.131238 Dec 20 03:35:12.164523 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 424/860] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:12 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1094 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:35:12.314213 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a41fa630-6b37-4970-93a1-05f9365912d2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:12.320805 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a41fa630-6b37-4970-93a1-05f9365912d2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:12.322713 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a41fa630-6b37-4970-93a1-05f9365912d2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:12.323401 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a41fa630-6b37-4970-93a1-05f9365912d2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:12.324460 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a41fa630-6b37-4970-93a1-05f9365912d2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:12.325250 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a41fa630-6b37-4970-93a1-05f9365912d2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:12.327281 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-27eecff6-44af-43c7-8984-f661733e3b9e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:12.327791 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-27eecff6-44af-43c7-8984-f661733e3b9e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:12.335285 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-27eecff6-44af-43c7-8984-f661733e3b9e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:12.338605 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-27eecff6-44af-43c7-8984-f661733e3b9e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:12.339471 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-27eecff6-44af-43c7-8984-f661733e3b9e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:12.339919 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-27eecff6-44af-43c7-8984-f661733e3b9e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:12.488267 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.objects.instance [None req-27eecff6-44af-43c7-8984-f661733e3b9e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lazy-loading 'services' on Instance uuid d2dfd907-6eb9-4420-b9dc-36fa0518d29a {{(pid=117012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:35:12.505261 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-a41fa630-6b37-4970-93a1-05f9365912d2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:12.530855 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-a41fa630-6b37-4970-93a1-05f9365912d2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:12.533106 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-a41fa630-6b37-4970-93a1-05f9365912d2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:12.534362 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a41fa630-6b37-4970-93a1-05f9365912d2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1739 microversion: 2.20 time: 0.225343 Dec 20 03:35:12.534926 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 437/861] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:12 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:12.544891 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-fccea300-83ec-4c84-8000-ccbc7a448cb8 req-7884d052-60f5-4f2f-8ea3-330e7cdc080b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2dfd907-6eb9-4420-b9dc-36fa0518d29a", "tag": "252e4b81-2b8b-4472-b0f9-0b2a9b974c88"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:35:12.547251 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:35:12.547251 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:35:12.560114 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-fccea300-83ec-4c84-8000-ccbc7a448cb8 req-7884d052-60f5-4f2f-8ea3-330e7cdc080b service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:12.562283 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-fccea300-83ec-4c84-8000-ccbc7a448cb8 req-7884d052-60f5-4f2f-8ea3-330e7cdc080b service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:12.581104 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-fccea300-83ec-4c84-8000-ccbc7a448cb8 req-7884d052-60f5-4f2f-8ea3-330e7cdc080b service nova] Creating event network-changed:252e4b81-2b8b-4472-b0f9-0b2a9b974c88 for instance d2dfd907-6eb9-4420-b9dc-36fa0518d29a on hv-cinder-81803 Dec 20 03:35:12.586588 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-fccea300-83ec-4c84-8000-ccbc7a448cb8 req-7884d052-60f5-4f2f-8ea3-330e7cdc080b service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050472 Dec 20 03:35:12.587514 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 438/862] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:35:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:35:12.593914 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-86c8a99e-69d3-4ef4-bc0a-4053a5e9a2a8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:12.594981 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-86c8a99e-69d3-4ef4-bc0a-4053a5e9a2a8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:12.601624 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-86c8a99e-69d3-4ef4-bc0a-4053a5e9a2a8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:12.602198 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-86c8a99e-69d3-4ef4-bc0a-4053a5e9a2a8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:12.603227 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-86c8a99e-69d3-4ef4-bc0a-4053a5e9a2a8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:12.603671 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-86c8a99e-69d3-4ef4-bc0a-4053a5e9a2a8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:12.620244 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-86c8a99e-69d3-4ef4-bc0a-4053a5e9a2a8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] HTTP exception thrown: Instance 4d0ea081-3dd8-40ec-bade-7fbf12f68c75 could not be found. Dec 20 03:35:12.624464 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-86c8a99e-69d3-4ef4-bc0a-4053a5e9a2a8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Returning 404 to user: Instance 4d0ea081-3dd8-40ec-bade-7fbf12f68c75 could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:35:12.624464 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-86c8a99e-69d3-4ef4-bc0a-4053a5e9a2a8 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 404 len: 111 microversion: 2.1 time: 0.033010 Dec 20 03:35:12.624464 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 439/863] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:12 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:35:12.630870 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-15a6fe39-63e5-46c8-acca-dc26d9ec7dbb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '.version_select at 0x7f49041b5e50>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:12.761524 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-27eecff6-44af-43c7-8984-f661733e3b9e tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "DELETE /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a/os-volume_attachments/2952c68a-b5bb-484e-a33e-ca7ef419315a" status: 202 len: 0 microversion: 2.1 time: 0.438395 Dec 20 03:35:12.762615 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 425/864] 10.222.0.53 () {58 vars in 1415 bytes} [Mon Dec 20 03:35:12 2021] DELETE /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a/os-volume_attachments/2952c68a-b5bb-484e-a33e-ca7ef419315a => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 20 03:35:12.774791 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f5bd1039-449b-400d-bf77-1ab8dc8fc636 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:12.780825 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f5bd1039-449b-400d-bf77-1ab8dc8fc636 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:12.786156 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-15a6fe39-63e5-46c8-acca-dc26d9ec7dbb tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-385587714" status: 202 len: 0 microversion: 2.1 time: 0.158208 Dec 20 03:35:12.789062 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 440/865] 10.222.0.53 () {58 vars in 1217 bytes} [Mon Dec 20 03:35:12 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-385587714 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 20 03:35:12.804179 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f5bd1039-449b-400d-bf77-1ab8dc8fc636 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:12.807125 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f5bd1039-449b-400d-bf77-1ab8dc8fc636 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:12.810319 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f5bd1039-449b-400d-bf77-1ab8dc8fc636 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:12.811138 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f5bd1039-449b-400d-bf77-1ab8dc8fc636 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:12.877024 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f5bd1039-449b-400d-bf77-1ab8dc8fc636 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109073 Dec 20 03:35:12.878396 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 426/866] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:35:12 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:35:13.184442 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-10e0f5bb-07b8-4ebd-a84a-ff5573b5600a tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:13.185208 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-10e0f5bb-07b8-4ebd-a84a-ff5573b5600a tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:13.288734 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-10e0f5bb-07b8-4ebd-a84a-ff5573b5600a tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:13.308093 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-10e0f5bb-07b8-4ebd-a84a-ff5573b5600a tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1094 microversion: 2.1 time: 0.126806 Dec 20 03:35:13.320102 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 441/867] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:13 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1094 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:13.553611 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d353c12b-6d71-4449-8317-f7a85f3b442e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:13.555140 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d353c12b-6d71-4449-8317-f7a85f3b442e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:13.562326 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d353c12b-6d71-4449-8317-f7a85f3b442e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:13.574148 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d353c12b-6d71-4449-8317-f7a85f3b442e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:13.575562 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d353c12b-6d71-4449-8317-f7a85f3b442e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:13.576261 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d353c12b-6d71-4449-8317-f7a85f3b442e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:13.896334 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d9aa8f90-b77a-4576-903b-7cebf61a81af tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:13.897689 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d9aa8f90-b77a-4576-903b-7cebf61a81af tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:13.915227 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d9aa8f90-b77a-4576-903b-7cebf61a81af tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:13.924962 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d9aa8f90-b77a-4576-903b-7cebf61a81af tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:13.926222 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d9aa8f90-b77a-4576-903b-7cebf61a81af tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:13.926879 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d9aa8f90-b77a-4576-903b-7cebf61a81af tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:13.999803 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d353c12b-6d71-4449-8317-f7a85f3b442e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:14.011395 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d353c12b-6d71-4449-8317-f7a85f3b442e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:14.013431 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d353c12b-6d71-4449-8317-f7a85f3b442e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:14.015457 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d353c12b-6d71-4449-8317-f7a85f3b442e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1739 microversion: 2.20 time: 0.465610 Dec 20 03:35:14.016592 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 427/868] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:13 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1739 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:14.045443 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d9aa8f90-b77a-4576-903b-7cebf61a81af tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159660 Dec 20 03:35:14.048414 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 442/869] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:35:13 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:35:14.329338 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-6a49244c-9e43-47c1-a551-204e54859732 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:14.330209 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6a49244c-9e43-47c1-a551-204e54859732 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:14.336942 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6a49244c-9e43-47c1-a551-204e54859732 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:14.337673 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6a49244c-9e43-47c1-a551-204e54859732 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:14.338565 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6a49244c-9e43-47c1-a551-204e54859732 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:14.339077 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6a49244c-9e43-47c1-a551-204e54859732 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:14.455714 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-6a49244c-9e43-47c1-a551-204e54859732 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:14.466856 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-6a49244c-9e43-47c1-a551-204e54859732 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1192 microversion: 2.1 time: 0.144002 Dec 20 03:35:14.467688 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 428/870] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:14 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1192 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:15.040301 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b2423ed3-0723-405e-ae47-010dbab94fe3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:15.041783 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-b2423ed3-0723-405e-ae47-010dbab94fe3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:15.057309 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c952084a-80fd-4be1-8be3-fca13bc67605 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:15.059898 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c952084a-80fd-4be1-8be3-fca13bc67605 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:15.075217 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b2423ed3-0723-405e-ae47-010dbab94fe3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:15.075732 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b2423ed3-0723-405e-ae47-010dbab94fe3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:15.079717 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c952084a-80fd-4be1-8be3-fca13bc67605 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:15.080172 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c952084a-80fd-4be1-8be3-fca13bc67605 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:15.080976 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c952084a-80fd-4be1-8be3-fca13bc67605 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:15.081932 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b2423ed3-0723-405e-ae47-010dbab94fe3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:15.082246 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b2423ed3-0723-405e-ae47-010dbab94fe3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:15.086285 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c952084a-80fd-4be1-8be3-fca13bc67605 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:15.135942 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c952084a-80fd-4be1-8be3-fca13bc67605 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083440 Dec 20 03:35:15.142086 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 429/871] 10.222.0.53 () {58 vars in 1301 bytes} [Mon Dec 20 03:35:15 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 20 03:35:15.148347 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-2f0e51cc-e69d-4b92-a2c3-9994aedbbd64 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:15.149089 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-2f0e51cc-e69d-4b92-a2c3-9994aedbbd64 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:15.160851 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2f0e51cc-e69d-4b92-a2c3-9994aedbbd64 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:15.161563 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2f0e51cc-e69d-4b92-a2c3-9994aedbbd64 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:15.164355 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2f0e51cc-e69d-4b92-a2c3-9994aedbbd64 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:15.165561 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2f0e51cc-e69d-4b92-a2c3-9994aedbbd64 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:15.267530 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-2f0e51cc-e69d-4b92-a2c3-9994aedbbd64 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] HTTP exception thrown: Instance d2dfd907-6eb9-4420-b9dc-36fa0518d29a is not attached to volume 2952c68a-b5bb-484e-a33e-ca7ef419315a Dec 20 03:35:15.268569 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-2f0e51cc-e69d-4b92-a2c3-9994aedbbd64 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Returning 404 to user: Instance d2dfd907-6eb9-4420-b9dc-36fa0518d29a is not attached to volume 2952c68a-b5bb-484e-a33e-ca7ef419315a {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:35:15.269837 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-2f0e51cc-e69d-4b92-a2c3-9994aedbbd64 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "DELETE /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a/os-volume_attachments/2952c68a-b5bb-484e-a33e-ca7ef419315a" status: 404 len: 154 microversion: 2.1 time: 0.126147 Dec 20 03:35:15.271012 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 430/872] 10.222.0.53 () {58 vars in 1415 bytes} [Mon Dec 20 03:35:15 2021] DELETE /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a/os-volume_attachments/2952c68a-b5bb-484e-a33e-ca7ef419315a => generated 154 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:35:15.348602 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b2423ed3-0723-405e-ae47-010dbab94fe3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:15.360116 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b2423ed3-0723-405e-ae47-010dbab94fe3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:15.375992 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b2423ed3-0723-405e-ae47-010dbab94fe3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:15.377887 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b2423ed3-0723-405e-ae47-010dbab94fe3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1739 microversion: 2.20 time: 0.343478 Dec 20 03:35:15.378448 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 443/873] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:15 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1739 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:15.501629 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-5ac17190-1543-44ff-a785-d8ed41c9f0ce tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:15.504251 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-5ac17190-1543-44ff-a785-d8ed41c9f0ce tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:15.514874 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5ac17190-1543-44ff-a785-d8ed41c9f0ce tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:15.515515 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5ac17190-1543-44ff-a785-d8ed41c9f0ce tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:15.516524 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5ac17190-1543-44ff-a785-d8ed41c9f0ce tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:15.517040 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5ac17190-1543-44ff-a785-d8ed41c9f0ce tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:15.636629 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-5ac17190-1543-44ff-a785-d8ed41c9f0ce tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:15.655534 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-5ac17190-1543-44ff-a785-d8ed41c9f0ce tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1210 microversion: 2.1 time: 0.161721 Dec 20 03:35:15.661645 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 431/874] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:15 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1210 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:16.400376 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-24c32146-08db-4de5-acff-0b305b581045 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:16.401077 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-24c32146-08db-4de5-acff-0b305b581045 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:16.408894 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-24c32146-08db-4de5-acff-0b305b581045 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:16.409430 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-24c32146-08db-4de5-acff-0b305b581045 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:16.410350 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-24c32146-08db-4de5-acff-0b305b581045 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:16.410851 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-24c32146-08db-4de5-acff-0b305b581045 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:16.579872 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-24c32146-08db-4de5-acff-0b305b581045 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:16.595590 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-24c32146-08db-4de5-acff-0b305b581045 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:16.598574 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-24c32146-08db-4de5-acff-0b305b581045 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:16.602997 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-24c32146-08db-4de5-acff-0b305b581045 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1739 microversion: 2.20 time: 0.206177 Dec 20 03:35:16.603341 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 444/875] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:16 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:16.652558 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-b5d8389a-7003-4220-8d4b-37429b319b1c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:16.653130 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-b5d8389a-7003-4220-8d4b-37429b319b1c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:16.671395 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b5d8389a-7003-4220-8d4b-37429b319b1c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:16.674152 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b5d8389a-7003-4220-8d4b-37429b319b1c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:16.675243 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b5d8389a-7003-4220-8d4b-37429b319b1c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:16.676284 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b5d8389a-7003-4220-8d4b-37429b319b1c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:16.679298 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f8bd40c6-3938-490a-921e-9dab5587ba59 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:16.680248 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-f8bd40c6-3938-490a-921e-9dab5587ba59 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:16.689400 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f8bd40c6-3938-490a-921e-9dab5587ba59 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:16.694110 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f8bd40c6-3938-490a-921e-9dab5587ba59 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:16.694110 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f8bd40c6-3938-490a-921e-9dab5587ba59 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:16.694110 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f8bd40c6-3938-490a-921e-9dab5587ba59 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:16.735869 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-b5d8389a-7003-4220-8d4b-37429b319b1c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Going to try to terminate instance {{(pid=117012) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:35:16.902477 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-f8bd40c6-3938-490a-921e-9dab5587ba59 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:16.922574 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f8bd40c6-3938-490a-921e-9dab5587ba59 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1278 microversion: 2.1 time: 0.237688 Dec 20 03:35:16.924372 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 445/876] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:16 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1278 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:35:17.125534 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-b5d8389a-7003-4220-8d4b-37429b319b1c tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "DELETE /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 204 len: 0 microversion: 2.1 time: 0.469914 Dec 20 03:35:17.125534 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 432/877] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:35:16 2021] DELETE /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:35:17.131107 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-bfcf957c-e420-4297-b9cc-981c802f46ae tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:17.132107 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-bfcf957c-e420-4297-b9cc-981c802f46ae tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:17.140727 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bfcf957c-e420-4297-b9cc-981c802f46ae tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:17.142845 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bfcf957c-e420-4297-b9cc-981c802f46ae tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:17.144487 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bfcf957c-e420-4297-b9cc-981c802f46ae tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:17.145539 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bfcf957c-e420-4297-b9cc-981c802f46ae tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:17.321864 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-bfcf957c-e420-4297-b9cc-981c802f46ae tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:17.330195 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-bfcf957c-e420-4297-b9cc-981c802f46ae tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1550 microversion: 2.1 time: 0.203785 Dec 20 03:35:17.330780 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 446/878] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:17 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1550 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:17.622662 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-06de39c8-ccfe-4680-b91a-c443a4e5a622 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:17.623339 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-06de39c8-ccfe-4680-b91a-c443a4e5a622 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:17.638282 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-06de39c8-ccfe-4680-b91a-c443a4e5a622 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:17.639836 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-06de39c8-ccfe-4680-b91a-c443a4e5a622 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:17.640720 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-06de39c8-ccfe-4680-b91a-c443a4e5a622 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:17.641330 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-06de39c8-ccfe-4680-b91a-c443a4e5a622 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:17.694028 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-e928741d-e6b8-42cd-a358-5b5ec605eb41 req-848dc09d-c8a6-4972-b2c0-02ea44ae3e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b572f265-bb17-4489-a53a-432eb4815ac6", "tag": "18e4f61a-85b3-4ab2-9fc5-c5bd02019210"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:35:17.696992 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:35:17.696992 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:35:17.710459 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-e928741d-e6b8-42cd-a358-5b5ec605eb41 req-848dc09d-c8a6-4972-b2c0-02ea44ae3e12 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:17.711205 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-e928741d-e6b8-42cd-a358-5b5ec605eb41 req-848dc09d-c8a6-4972-b2c0-02ea44ae3e12 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:17.730753 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-e928741d-e6b8-42cd-a358-5b5ec605eb41 req-848dc09d-c8a6-4972-b2c0-02ea44ae3e12 service nova] Creating event network-changed:18e4f61a-85b3-4ab2-9fc5-c5bd02019210 for instance b572f265-bb17-4489-a53a-432eb4815ac6 on hv-cinder-81803 Dec 20 03:35:17.738774 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-e928741d-e6b8-42cd-a358-5b5ec605eb41 req-848dc09d-c8a6-4972-b2c0-02ea44ae3e12 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055983 Dec 20 03:35:17.740059 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 447/879] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:35:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:35:17.901857 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-06de39c8-ccfe-4680-b91a-c443a4e5a622 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:17.913881 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-06de39c8-ccfe-4680-b91a-c443a4e5a622 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:17.915772 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-06de39c8-ccfe-4680-b91a-c443a4e5a622 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:17.917169 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-06de39c8-ccfe-4680-b91a-c443a4e5a622 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1739 microversion: 2.20 time: 0.298816 Dec 20 03:35:17.917897 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 433/880] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:17 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1739 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:17.942115 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e5d7e333-1202-4114-8cc8-bf4dac1c19c0 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:17.943124 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e5d7e333-1202-4114-8cc8-bf4dac1c19c0 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:17.949997 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e5d7e333-1202-4114-8cc8-bf4dac1c19c0 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:17.950701 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e5d7e333-1202-4114-8cc8-bf4dac1c19c0 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:17.951744 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e5d7e333-1202-4114-8cc8-bf4dac1c19c0 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:17.952375 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e5d7e333-1202-4114-8cc8-bf4dac1c19c0 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:18.030455 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ad4ad933-0760-4829-8d13-e250a2233a0a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:18.031308 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ad4ad933-0760-4829-8d13-e250a2233a0a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:18.037801 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ad4ad933-0760-4829-8d13-e250a2233a0a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:18.038659 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ad4ad933-0760-4829-8d13-e250a2233a0a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:18.039696 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ad4ad933-0760-4829-8d13-e250a2233a0a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:18.040337 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ad4ad933-0760-4829-8d13-e250a2233a0a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:18.058792 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-ad4ad933-0760-4829-8d13-e250a2233a0a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] HTTP exception thrown: Instance 4d0ea081-3dd8-40ec-bade-7fbf12f68c75 could not be found. Dec 20 03:35:18.059740 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ad4ad933-0760-4829-8d13-e250a2233a0a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Returning 404 to user: Instance 4d0ea081-3dd8-40ec-bade-7fbf12f68c75 could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:35:18.061129 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ad4ad933-0760-4829-8d13-e250a2233a0a tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "DELETE /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 404 len: 111 microversion: 2.1 time: 0.034598 Dec 20 03:35:18.062529 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 434/881] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:35:18 2021] DELETE /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:35:18.075708 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-431e1432-8957-4f23-9ba8-7b1278f24a3e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:18.076582 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-431e1432-8957-4f23-9ba8-7b1278f24a3e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 4d0ea081-3dd8-40ec-bade-7fbf12f68c75] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:18.083551 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-431e1432-8957-4f23-9ba8-7b1278f24a3e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:18.084272 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-431e1432-8957-4f23-9ba8-7b1278f24a3e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:18.085334 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-431e1432-8957-4f23-9ba8-7b1278f24a3e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:18.086488 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-431e1432-8957-4f23-9ba8-7b1278f24a3e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:18.118670 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-431e1432-8957-4f23-9ba8-7b1278f24a3e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] HTTP exception thrown: Instance 4d0ea081-3dd8-40ec-bade-7fbf12f68c75 could not be found. Dec 20 03:35:18.120423 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-431e1432-8957-4f23-9ba8-7b1278f24a3e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Returning 404 to user: Instance 4d0ea081-3dd8-40ec-bade-7fbf12f68c75 could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:35:18.122544 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-431e1432-8957-4f23-9ba8-7b1278f24a3e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75" status: 404 len: 111 microversion: 2.1 time: 0.050075 Dec 20 03:35:18.124361 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 435/882] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:18 2021] GET /compute/v2.1/servers/4d0ea081-3dd8-40ec-bade-7fbf12f68c75 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:35:18.153230 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-e5d7e333-1202-4114-8cc8-bf4dac1c19c0 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:18.162484 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e5d7e333-1202-4114-8cc8-bf4dac1c19c0 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1266 microversion: 2.1 time: 0.224323 Dec 20 03:35:18.163332 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 448/883] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:17 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:35:18.349350 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-0e2d48e5-60cb-43f4-ac1f-514845f2be67 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:18.350390 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-0e2d48e5-60cb-43f4-ac1f-514845f2be67 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:18.357104 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0e2d48e5-60cb-43f4-ac1f-514845f2be67 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:18.358544 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0e2d48e5-60cb-43f4-ac1f-514845f2be67 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:18.359655 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0e2d48e5-60cb-43f4-ac1f-514845f2be67 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:18.360383 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0e2d48e5-60cb-43f4-ac1f-514845f2be67 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:18.616151 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0e2d48e5-60cb-43f4-ac1f-514845f2be67 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:18.628067 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-0e2d48e5-60cb-43f4-ac1f-514845f2be67 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1550 microversion: 2.1 time: 0.282315 Dec 20 03:35:18.629421 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 436/884] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:18 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1550 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:18.935797 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ca3857d7-aa9c-402f-93ea-a5ab49118f9d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:18.937060 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ca3857d7-aa9c-402f-93ea-a5ab49118f9d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:18.951704 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ca3857d7-aa9c-402f-93ea-a5ab49118f9d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:18.953797 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ca3857d7-aa9c-402f-93ea-a5ab49118f9d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:18.953797 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ca3857d7-aa9c-402f-93ea-a5ab49118f9d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:18.954243 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ca3857d7-aa9c-402f-93ea-a5ab49118f9d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:19.132423 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ca3857d7-aa9c-402f-93ea-a5ab49118f9d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:19.141928 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ca3857d7-aa9c-402f-93ea-a5ab49118f9d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:19.143872 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ca3857d7-aa9c-402f-93ea-a5ab49118f9d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:19.145403 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ca3857d7-aa9c-402f-93ea-a5ab49118f9d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1739 microversion: 2.20 time: 0.213650 Dec 20 03:35:19.146257 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 449/885] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:18 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:35:19.179828 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c27476fc-2691-4ea6-b3f8-d6b71a49fbf7 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:19.180459 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c27476fc-2691-4ea6-b3f8-d6b71a49fbf7 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:19.188212 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c27476fc-2691-4ea6-b3f8-d6b71a49fbf7 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:19.188666 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c27476fc-2691-4ea6-b3f8-d6b71a49fbf7 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:19.189498 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c27476fc-2691-4ea6-b3f8-d6b71a49fbf7 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:19.190237 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c27476fc-2691-4ea6-b3f8-d6b71a49fbf7 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:19.345625 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c27476fc-2691-4ea6-b3f8-d6b71a49fbf7 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:19.354705 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c27476fc-2691-4ea6-b3f8-d6b71a49fbf7 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1266 microversion: 2.1 time: 0.178139 Dec 20 03:35:19.357510 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 437/886] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:19 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:19.441877 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-424a3d98-69a4-42fe-8a70-078bee00a3d2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:19.443449 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-424a3d98-69a4-42fe-8a70-078bee00a3d2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:19.449914 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-424a3d98-69a4-42fe-8a70-078bee00a3d2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:19.450371 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-424a3d98-69a4-42fe-8a70-078bee00a3d2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:19.451382 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-424a3d98-69a4-42fe-8a70-078bee00a3d2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:19.451778 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-424a3d98-69a4-42fe-8a70-078bee00a3d2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:19.472341 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-424a3d98-69a4-42fe-8a70-078bee00a3d2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] HTTP exception thrown: Instance 5ec437d6-633a-468c-aa6a-d4c81df62919 could not be found. Dec 20 03:35:19.473273 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-424a3d98-69a4-42fe-8a70-078bee00a3d2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Returning 404 to user: Instance 5ec437d6-633a-468c-aa6a-d4c81df62919 could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:35:19.474140 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-424a3d98-69a4-42fe-8a70-078bee00a3d2 tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "DELETE /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 404 len: 111 microversion: 2.1 time: 0.039964 Dec 20 03:35:19.475014 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 450/887] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:35:19 2021] DELETE /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:35:19.484899 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-75db4cd4-f4a7-4cdf-9429-8155445e0f8e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:19.485807 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-75db4cd4-f4a7-4cdf-9429-8155445e0f8e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] [instance: 5ec437d6-633a-468c-aa6a-d4c81df62919] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:19.497110 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-75db4cd4-f4a7-4cdf-9429-8155445e0f8e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:19.497603 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-75db4cd4-f4a7-4cdf-9429-8155445e0f8e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:19.498972 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-75db4cd4-f4a7-4cdf-9429-8155445e0f8e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:19.499424 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-75db4cd4-f4a7-4cdf-9429-8155445e0f8e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:19.520611 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-75db4cd4-f4a7-4cdf-9429-8155445e0f8e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] HTTP exception thrown: Instance 5ec437d6-633a-468c-aa6a-d4c81df62919 could not be found. Dec 20 03:35:19.520611 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-75db4cd4-f4a7-4cdf-9429-8155445e0f8e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] Returning 404 to user: Instance 5ec437d6-633a-468c-aa6a-d4c81df62919 could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:35:19.521256 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-75db4cd4-f4a7-4cdf-9429-8155445e0f8e tempest-AttachVolumeTestJSON-784732766 tempest-AttachVolumeTestJSON-784732766-project] 10.222.0.53 "GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919" status: 404 len: 111 microversion: 2.1 time: 0.042335 Dec 20 03:35:19.525426 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 438/888] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:19 2021] GET /compute/v2.1/servers/5ec437d6-633a-468c-aa6a-d4c81df62919 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:35:19.708380 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1f3f86bc-1b53-4fc6-9439-5686446320a8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:19.708380 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1f3f86bc-1b53-4fc6-9439-5686446320a8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:19.708380 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1f3f86bc-1b53-4fc6-9439-5686446320a8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:19.708380 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1f3f86bc-1b53-4fc6-9439-5686446320a8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:19.709566 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1f3f86bc-1b53-4fc6-9439-5686446320a8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:19.709566 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1f3f86bc-1b53-4fc6-9439-5686446320a8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:19.992905 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-1f3f86bc-1b53-4fc6-9439-5686446320a8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:20.006554 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1f3f86bc-1b53-4fc6-9439-5686446320a8 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1550 microversion: 2.1 time: 0.364474 Dec 20 03:35:20.007389 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 451/889] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:19 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1550 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:20.163565 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-78e456c4-2c7b-4f6a-b776-d609482f52bf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:20.164241 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-78e456c4-2c7b-4f6a-b776-d609482f52bf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:20.170837 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-78e456c4-2c7b-4f6a-b776-d609482f52bf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:20.171339 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-78e456c4-2c7b-4f6a-b776-d609482f52bf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:20.172123 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-78e456c4-2c7b-4f6a-b776-d609482f52bf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:20.172563 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-78e456c4-2c7b-4f6a-b776-d609482f52bf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:20.321847 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-78e456c4-2c7b-4f6a-b776-d609482f52bf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:20.331083 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-78e456c4-2c7b-4f6a-b776-d609482f52bf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:20.332956 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-78e456c4-2c7b-4f6a-b776-d609482f52bf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:20.334150 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-78e456c4-2c7b-4f6a-b776-d609482f52bf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1739 microversion: 2.20 time: 0.174459 Dec 20 03:35:20.334703 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 439/890] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:20 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:20.372587 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-9ccdb4ed-4ee2-45a4-b939-654e87713204 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:20.374119 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-9ccdb4ed-4ee2-45a4-b939-654e87713204 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:20.380234 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9ccdb4ed-4ee2-45a4-b939-654e87713204 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:20.380688 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9ccdb4ed-4ee2-45a4-b939-654e87713204 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:20.381503 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9ccdb4ed-4ee2-45a4-b939-654e87713204 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:20.381948 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9ccdb4ed-4ee2-45a4-b939-654e87713204 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:20.590565 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9ccdb4ed-4ee2-45a4-b939-654e87713204 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:20.598508 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-9ccdb4ed-4ee2-45a4-b939-654e87713204 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1266 microversion: 2.1 time: 0.229480 Dec 20 03:35:20.599343 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 452/891] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:20 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:20.668511 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-60802bef-4b89-4ca3-aba1-dce3e76523eb req-4242f473-d1d3-4fbe-82a7-1a356f8555ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2dfd907-6eb9-4420-b9dc-36fa0518d29a", "name": "network-vif-deleted", "tag": "252e4b81-2b8b-4472-b0f9-0b2a9b974c88"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:35:20.678083 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:35:20.678083 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:35:20.691608 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-60802bef-4b89-4ca3-aba1-dce3e76523eb req-4242f473-d1d3-4fbe-82a7-1a356f8555ac service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:20.691608 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-60802bef-4b89-4ca3-aba1-dce3e76523eb req-4242f473-d1d3-4fbe-82a7-1a356f8555ac service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:20.704758 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-60802bef-4b89-4ca3-aba1-dce3e76523eb req-4242f473-d1d3-4fbe-82a7-1a356f8555ac service nova] Creating event network-vif-deleted:252e4b81-2b8b-4472-b0f9-0b2a9b974c88 for instance d2dfd907-6eb9-4420-b9dc-36fa0518d29a on hv-cinder-81803 Dec 20 03:35:20.718691 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-60802bef-4b89-4ca3-aba1-dce3e76523eb req-4242f473-d1d3-4fbe-82a7-1a356f8555ac service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053618 Dec 20 03:35:20.719806 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 440/892] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:35:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:35:21.026292 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-c0bf0314-ae3f-47dc-abba-a39536d2ff11 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:21.027829 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-c0bf0314-ae3f-47dc-abba-a39536d2ff11 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:21.039549 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c0bf0314-ae3f-47dc-abba-a39536d2ff11 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:21.040611 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c0bf0314-ae3f-47dc-abba-a39536d2ff11 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:21.041752 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c0bf0314-ae3f-47dc-abba-a39536d2ff11 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:21.042464 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c0bf0314-ae3f-47dc-abba-a39536d2ff11 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:21.096996 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c0bf0314-ae3f-47dc-abba-a39536d2ff11 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:21.098721 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c0bf0314-ae3f-47dc-abba-a39536d2ff11 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:21.099500 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.objects.instance [None req-c0bf0314-ae3f-47dc-abba-a39536d2ff11 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lazy-loading 'fault' on Instance uuid d2dfd907-6eb9-4420-b9dc-36fa0518d29a {{(pid=117011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:35:21.156498 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-c0bf0314-ae3f-47dc-abba-a39536d2ff11 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2523da3baff41f18a9037d19d5ca886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74667b9b73e542e5a65f354d431c3b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:21.167050 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-c0bf0314-ae3f-47dc-abba-a39536d2ff11 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 200 len: 1346 microversion: 2.1 time: 0.145082 Dec 20 03:35:21.180291 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 453/893] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:21 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 1346 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:21.353511 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-12b0d1fc-7697-4f5a-9544-01300e4e6d27 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:21.354867 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-12b0d1fc-7697-4f5a-9544-01300e4e6d27 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:21.374211 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-12b0d1fc-7697-4f5a-9544-01300e4e6d27 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:21.375172 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-12b0d1fc-7697-4f5a-9544-01300e4e6d27 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:21.376164 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-12b0d1fc-7697-4f5a-9544-01300e4e6d27 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:21.377606 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-12b0d1fc-7697-4f5a-9544-01300e4e6d27 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:21.585169 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-12b0d1fc-7697-4f5a-9544-01300e4e6d27 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:21.596572 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-12b0d1fc-7697-4f5a-9544-01300e4e6d27 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:21.598430 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-12b0d1fc-7697-4f5a-9544-01300e4e6d27 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:21.600417 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-12b0d1fc-7697-4f5a-9544-01300e4e6d27 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1739 microversion: 2.20 time: 0.252019 Dec 20 03:35:21.601691 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 441/894] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:21 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:21.616156 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e48f3d40-01a2-41ff-ab8d-44cb212805b1 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:21.616832 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e48f3d40-01a2-41ff-ab8d-44cb212805b1 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:21.633608 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e48f3d40-01a2-41ff-ab8d-44cb212805b1 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:21.646189 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e48f3d40-01a2-41ff-ab8d-44cb212805b1 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:21.646189 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e48f3d40-01a2-41ff-ab8d-44cb212805b1 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:21.646189 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e48f3d40-01a2-41ff-ab8d-44cb212805b1 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:21.868336 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-e48f3d40-01a2-41ff-ab8d-44cb212805b1 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:21.876275 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e48f3d40-01a2-41ff-ab8d-44cb212805b1 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1266 microversion: 2.1 time: 0.264200 Dec 20 03:35:21.878426 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 454/895] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:21 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:22.197276 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a67e6f6c-1c3d-492e-a166-126769cc7c2a tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:22.197891 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a67e6f6c-1c3d-492e-a166-126769cc7c2a tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] [instance: d2dfd907-6eb9-4420-b9dc-36fa0518d29a] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:22.205954 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a67e6f6c-1c3d-492e-a166-126769cc7c2a tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:22.206405 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a67e6f6c-1c3d-492e-a166-126769cc7c2a tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:22.207190 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a67e6f6c-1c3d-492e-a166-126769cc7c2a tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:22.207623 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a67e6f6c-1c3d-492e-a166-126769cc7c2a tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:22.223133 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-a67e6f6c-1c3d-492e-a166-126769cc7c2a tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] HTTP exception thrown: Instance d2dfd907-6eb9-4420-b9dc-36fa0518d29a could not be found. Dec 20 03:35:22.223735 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a67e6f6c-1c3d-492e-a166-126769cc7c2a tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Returning 404 to user: Instance d2dfd907-6eb9-4420-b9dc-36fa0518d29a could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:35:22.224565 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a67e6f6c-1c3d-492e-a166-126769cc7c2a tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a" status: 404 len: 111 microversion: 2.1 time: 0.031099 Dec 20 03:35:22.225115 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 442/896] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:22 2021] GET /compute/v2.1/servers/d2dfd907-6eb9-4420-b9dc-36fa0518d29a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:35:22.234400 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-91195c6b-855e-485c-ab91-c96aeee3ed25 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] Calling method '.version_select at 0x7f490414b4c0>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:22.316280 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-91195c6b-855e-485c-ab91-c96aeee3ed25 tempest-TestMinimumBasicScenario-1745353868 tempest-TestMinimumBasicScenario-1745353868-project] 10.222.0.53 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-26851016" status: 202 len: 0 microversion: 2.1 time: 0.086752 Dec 20 03:35:22.316867 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 455/897] 10.222.0.53 () {58 vars in 1265 bytes} [Mon Dec 20 03:35:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-26851016 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 20 03:35:22.620137 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ec2d08e1-0f9a-41fc-b40f-d2b9e0e34cdb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:22.620986 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ec2d08e1-0f9a-41fc-b40f-d2b9e0e34cdb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:22.629005 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ec2d08e1-0f9a-41fc-b40f-d2b9e0e34cdb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:22.629668 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ec2d08e1-0f9a-41fc-b40f-d2b9e0e34cdb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:22.630585 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ec2d08e1-0f9a-41fc-b40f-d2b9e0e34cdb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:22.631091 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ec2d08e1-0f9a-41fc-b40f-d2b9e0e34cdb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:22.774648 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-ec2d08e1-0f9a-41fc-b40f-d2b9e0e34cdb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:22.783404 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-ec2d08e1-0f9a-41fc-b40f-d2b9e0e34cdb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:22.785126 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-ec2d08e1-0f9a-41fc-b40f-d2b9e0e34cdb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:22.786299 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ec2d08e1-0f9a-41fc-b40f-d2b9e0e34cdb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1739 microversion: 2.20 time: 0.169920 Dec 20 03:35:22.786882 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 443/898] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:22 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:35:22.893115 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-259a9550-3603-4388-b467-b6674c31c6dc tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:22.893856 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-259a9550-3603-4388-b467-b6674c31c6dc tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:22.900748 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-259a9550-3603-4388-b467-b6674c31c6dc tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:22.908824 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-259a9550-3603-4388-b467-b6674c31c6dc tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:22.908824 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-259a9550-3603-4388-b467-b6674c31c6dc tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:22.908824 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-259a9550-3603-4388-b467-b6674c31c6dc tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:23.179295 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-259a9550-3603-4388-b467-b6674c31c6dc tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:23.187406 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-259a9550-3603-4388-b467-b6674c31c6dc tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1266 microversion: 2.1 time: 0.298435 Dec 20 03:35:23.195691 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 456/899] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:22 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:23.804911 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-18c50bae-89f7-4e61-bd90-a7cbeb87b4ee tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:23.805818 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-18c50bae-89f7-4e61-bd90-a7cbeb87b4ee tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:23.813309 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-18c50bae-89f7-4e61-bd90-a7cbeb87b4ee tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:23.813758 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-18c50bae-89f7-4e61-bd90-a7cbeb87b4ee tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:23.814601 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-18c50bae-89f7-4e61-bd90-a7cbeb87b4ee tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:23.815038 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-18c50bae-89f7-4e61-bd90-a7cbeb87b4ee tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:24.079377 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-18c50bae-89f7-4e61-bd90-a7cbeb87b4ee tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:24.088346 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-18c50bae-89f7-4e61-bd90-a7cbeb87b4ee tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:24.090067 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-18c50bae-89f7-4e61-bd90-a7cbeb87b4ee tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:24.091239 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-18c50bae-89f7-4e61-bd90-a7cbeb87b4ee tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1721 microversion: 2.20 time: 0.290099 Dec 20 03:35:24.092451 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 444/900] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:23 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:24.204664 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-090c2739-b539-4236-aa3a-23dc7adea900 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:24.205590 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-090c2739-b539-4236-aa3a-23dc7adea900 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:24.211887 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-090c2739-b539-4236-aa3a-23dc7adea900 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:24.212340 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-090c2739-b539-4236-aa3a-23dc7adea900 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:24.213203 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-090c2739-b539-4236-aa3a-23dc7adea900 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:24.213701 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-090c2739-b539-4236-aa3a-23dc7adea900 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:24.396025 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-090c2739-b539-4236-aa3a-23dc7adea900 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:24.404681 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-090c2739-b539-4236-aa3a-23dc7adea900 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1266 microversion: 2.1 time: 0.203834 Dec 20 03:35:24.405537 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 457/901] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:24 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:25.110819 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1f6f66ee-9fe6-4130-bb94-63746999eb6a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:25.111527 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1f6f66ee-9fe6-4130-bb94-63746999eb6a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:25.118217 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1f6f66ee-9fe6-4130-bb94-63746999eb6a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:25.118675 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1f6f66ee-9fe6-4130-bb94-63746999eb6a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:25.119465 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1f6f66ee-9fe6-4130-bb94-63746999eb6a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:25.119914 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1f6f66ee-9fe6-4130-bb94-63746999eb6a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:25.376761 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1f6f66ee-9fe6-4130-bb94-63746999eb6a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:25.384854 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1f6f66ee-9fe6-4130-bb94-63746999eb6a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:25.386814 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1f6f66ee-9fe6-4130-bb94-63746999eb6a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:25.388202 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1f6f66ee-9fe6-4130-bb94-63746999eb6a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1721 microversion: 2.20 time: 0.282138 Dec 20 03:35:25.400202 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 445/902] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:25 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1721 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:25.428326 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-216afc9f-344b-40dc-9664-fc59e07465ec tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:25.429044 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-216afc9f-344b-40dc-9664-fc59e07465ec tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:25.444703 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-216afc9f-344b-40dc-9664-fc59e07465ec tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:25.446179 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-216afc9f-344b-40dc-9664-fc59e07465ec tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:25.447612 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-216afc9f-344b-40dc-9664-fc59e07465ec tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:25.448410 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-216afc9f-344b-40dc-9664-fc59e07465ec tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:25.468133 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-45ebafdb-4767-4dc3-be98-347175610991 req-a112c19e-ffa5-4eb2-aa6b-1f886b8360d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1645c1-a90b-406b-ba58-0620598ecf89", "name": "network-vif-unplugged", "status": "completed", "tag": "31810791-54e6-413e-889b-510ef52f5b14"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:35:25.471718 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:35:25.471718 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:35:25.486701 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-45ebafdb-4767-4dc3-be98-347175610991 req-a112c19e-ffa5-4eb2-aa6b-1f886b8360d8 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:25.490798 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-45ebafdb-4767-4dc3-be98-347175610991 req-a112c19e-ffa5-4eb2-aa6b-1f886b8360d8 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:25.528709 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-45ebafdb-4767-4dc3-be98-347175610991 req-a112c19e-ffa5-4eb2-aa6b-1f886b8360d8 service nova] Creating event network-vif-unplugged:31810791-54e6-413e-889b-510ef52f5b14 for instance 4a1645c1-a90b-406b-ba58-0620598ecf89 on hv-cinder-81803 Dec 20 03:35:25.538515 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-45ebafdb-4767-4dc3-be98-347175610991 req-a112c19e-ffa5-4eb2-aa6b-1f886b8360d8 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075863 Dec 20 03:35:25.539539 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 446/903] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:35:25 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:35:25.705639 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-216afc9f-344b-40dc-9664-fc59e07465ec tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:25.719262 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-216afc9f-344b-40dc-9664-fc59e07465ec tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1266 microversion: 2.1 time: 0.301170 Dec 20 03:35:25.724914 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 458/904] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:25 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1266 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:26.408623 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-9bad2636-c22e-407f-8c36-decc41ad8102 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:26.409328 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-9bad2636-c22e-407f-8c36-decc41ad8102 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:26.417088 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9bad2636-c22e-407f-8c36-decc41ad8102 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:26.417962 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9bad2636-c22e-407f-8c36-decc41ad8102 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:26.419002 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9bad2636-c22e-407f-8c36-decc41ad8102 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:26.419714 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9bad2636-c22e-407f-8c36-decc41ad8102 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:26.493448 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-087aed79-1417-416e-afae-52692169271e tempest-VolumesGetTestJSON-1613978294 tempest-VolumesGetTestJSON-1613978294-project] Action: 'create', calling method: .version_select at 0x7f490414ec10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-971445562", "metadata": {"Type": "work"}}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:35:26.638815 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9bad2636-c22e-407f-8c36-decc41ad8102 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:26.646782 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9bad2636-c22e-407f-8c36-decc41ad8102 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:26.648265 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9bad2636-c22e-407f-8c36-decc41ad8102 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:26.649481 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-9bad2636-c22e-407f-8c36-decc41ad8102 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1664 microversion: 2.20 time: 0.245721 Dec 20 03:35:26.650030 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 459/905] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:26 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1664 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:35:26.672752 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-fe0119c2-c6af-4175-a5f0-56cbeeaf768e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "065d642a-89f4-4804-aab4-ecc5bfdbd403"}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:35:26.673798 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-fe0119c2-c6af-4175-a5f0-56cbeeaf768e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:26.679655 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fe0119c2-c6af-4175-a5f0-56cbeeaf768e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:26.680081 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fe0119c2-c6af-4175-a5f0-56cbeeaf768e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:26.680877 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fe0119c2-c6af-4175-a5f0-56cbeeaf768e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:26.681340 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fe0119c2-c6af-4175-a5f0-56cbeeaf768e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:27.227434 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-087aed79-1417-416e-afae-52692169271e tempest-VolumesGetTestJSON-1613978294 tempest-VolumesGetTestJSON-1613978294-project] 10.222.0.53 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.931479 Dec 20 03:35:27.227434 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 447/906] 10.222.0.53 () {60 vars in 1155 bytes} [Mon Dec 20 03:35:26 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 933 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 20 03:35:27.229446 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-06def330-aee7-4689-91b0-5ede247e2f64 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:27.230523 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-06def330-aee7-4689-91b0-5ede247e2f64 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:27.237115 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-06def330-aee7-4689-91b0-5ede247e2f64 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:27.237645 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-06def330-aee7-4689-91b0-5ede247e2f64 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:27.238370 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-06def330-aee7-4689-91b0-5ede247e2f64 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:27.238819 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-06def330-aee7-4689-91b0-5ede247e2f64 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:27.407923 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-06def330-aee7-4689-91b0-5ede247e2f64 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:27.424773 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-06def330-aee7-4689-91b0-5ede247e2f64 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1266 microversion: 2.1 time: 0.199444 Dec 20 03:35:27.425495 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 448/907] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:27 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:27.430034 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-3f364b60-7ff7-4f33-a783-12d6f8c1b004 tempest-VolumesGetTestJSON-1613978294 tempest-VolumesGetTestJSON-1613978294-project] Calling method '.version_select at 0x7f490418b820>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:27.503895 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-3f364b60-7ff7-4f33-a783-12d6f8c1b004 tempest-VolumesGetTestJSON-1613978294 tempest-VolumesGetTestJSON-1613978294-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/4b6d7970-c298-4f76-bd53-ad6068c8382a" status: 200 len: 352 microversion: 2.1 time: 0.077055 Dec 20 03:35:27.505613 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 449/908] 10.222.0.53 () {58 vars in 1244 bytes} [Mon Dec 20 03:35:27 2021] GET /compute/v2.1/os-volumes/4b6d7970-c298-4f76-bd53-ad6068c8382a => generated 352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:35:27.803898 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-fe0119c2-c6af-4175-a5f0-56cbeeaf768e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.135572 Dec 20 03:35:27.805605 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 460/909] 10.222.0.53 () {62 vars in 1363 bytes} [Mon Dec 20 03:35:26 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/os-volume_attachments => generated 188 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:35:27.925877 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-18591b3d-2c7e-4821-b97b-d5dc98083b1e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:35:27.926758 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-18591b3d-2c7e-4821-b97b-d5dc98083b1e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:27.933050 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-18591b3d-2c7e-4821-b97b-d5dc98083b1e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:27.933528 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-18591b3d-2c7e-4821-b97b-d5dc98083b1e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:27.934329 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-18591b3d-2c7e-4821-b97b-d5dc98083b1e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:27.934920 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-18591b3d-2c7e-4821-b97b-d5dc98083b1e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:28.363426 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-18591b3d-2c7e-4821-b97b-d5dc98083b1e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action" status: 202 len: 0 microversion: 2.20 time: 0.441014 Dec 20 03:35:28.367630 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 450/910] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:35:27 2021] POST /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:35:28.372608 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-6d21f43f-1442-4aab-b516-7ee7e5b9d856 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:28.373243 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6d21f43f-1442-4aab-b516-7ee7e5b9d856 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:28.380522 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6d21f43f-1442-4aab-b516-7ee7e5b9d856 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:28.380966 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6d21f43f-1442-4aab-b516-7ee7e5b9d856 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:28.381966 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6d21f43f-1442-4aab-b516-7ee7e5b9d856 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:28.382592 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6d21f43f-1442-4aab-b516-7ee7e5b9d856 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:28.442039 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-557acc59-a470-4618-b963-e146490e84be tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:28.442691 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-557acc59-a470-4618-b963-e146490e84be tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:28.450083 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-557acc59-a470-4618-b963-e146490e84be tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:28.450937 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-557acc59-a470-4618-b963-e146490e84be tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:28.451878 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-557acc59-a470-4618-b963-e146490e84be tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:28.452316 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-557acc59-a470-4618-b963-e146490e84be tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:28.603925 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6d21f43f-1442-4aab-b516-7ee7e5b9d856 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:28.613945 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6d21f43f-1442-4aab-b516-7ee7e5b9d856 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:28.620068 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6d21f43f-1442-4aab-b516-7ee7e5b9d856 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:28.628332 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-6d21f43f-1442-4aab-b516-7ee7e5b9d856 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1750 microversion: 2.20 time: 0.259371 Dec 20 03:35:28.629512 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 461/911] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:28 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1750 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:35:28.634410 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d2277ad1-d97d-4600-b1db-acd7ccf000cc tempest-VolumesGetTestJSON-1613978294 tempest-VolumesGetTestJSON-1613978294-project] Calling method '.version_select at 0x7f49041b6a60>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:28.690081 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-557acc59-a470-4618-b963-e146490e84be tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:28.693400 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-557acc59-a470-4618-b963-e146490e84be tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1266 microversion: 2.1 time: 0.254971 Dec 20 03:35:28.694470 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 451/912] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:28 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:35:28.707322 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d2277ad1-d97d-4600-b1db-acd7ccf000cc tempest-VolumesGetTestJSON-1613978294 tempest-VolumesGetTestJSON-1613978294-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/4b6d7970-c298-4f76-bd53-ad6068c8382a" status: 200 len: 353 microversion: 2.1 time: 0.076321 Dec 20 03:35:28.708266 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 462/913] 10.222.0.53 () {58 vars in 1244 bytes} [Mon Dec 20 03:35:28 2021] GET /compute/v2.1/os-volumes/4b6d7970-c298-4f76-bd53-ad6068c8382a => generated 353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:35:28.725992 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-18d5e118-3f52-434d-94e5-1216f102e8fd tempest-VolumesGetTestJSON-1613978294 tempest-VolumesGetTestJSON-1613978294-project] Calling method '.version_select at 0x7f49087f8ee0>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:28.774640 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-18d5e118-3f52-434d-94e5-1216f102e8fd tempest-VolumesGetTestJSON-1613978294 tempest-VolumesGetTestJSON-1613978294-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/4b6d7970-c298-4f76-bd53-ad6068c8382a" status: 200 len: 353 microversion: 2.1 time: 0.052991 Dec 20 03:35:28.775372 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 452/914] 10.222.0.53 () {58 vars in 1244 bytes} [Mon Dec 20 03:35:28 2021] GET /compute/v2.1/os-volumes/4b6d7970-c298-4f76-bd53-ad6068c8382a => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:35:28.791329 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-54747aa9-0b11-48dd-8826-a179425e6ae3 tempest-VolumesGetTestJSON-1613978294 tempest-VolumesGetTestJSON-1613978294-project] Calling method '.version_select at 0x7f490423ef70>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:29.058258 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-54747aa9-0b11-48dd-8826-a179425e6ae3 tempest-VolumesGetTestJSON-1613978294 tempest-VolumesGetTestJSON-1613978294-project] 10.222.0.53 "DELETE /compute/v2.1/os-volumes/4b6d7970-c298-4f76-bd53-ad6068c8382a" status: 202 len: 0 microversion: 2.1 time: 0.270430 Dec 20 03:35:29.071138 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 463/915] 10.222.0.53 () {58 vars in 1247 bytes} [Mon Dec 20 03:35:28 2021] DELETE /compute/v2.1/os-volumes/4b6d7970-c298-4f76-bd53-ad6068c8382a => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 20 03:35:29.071272 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-409e4179-7d15-4688-82e0-65bea2542252 tempest-VolumesGetTestJSON-1613978294 tempest-VolumesGetTestJSON-1613978294-project] Calling method '.version_select at 0x7f49087f8c10>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:29.121591 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-409e4179-7d15-4688-82e0-65bea2542252 tempest-VolumesGetTestJSON-1613978294 tempest-VolumesGetTestJSON-1613978294-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/4b6d7970-c298-4f76-bd53-ad6068c8382a" status: 200 len: 352 microversion: 2.1 time: 0.057270 Dec 20 03:35:29.126867 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 453/916] 10.222.0.53 () {58 vars in 1244 bytes} [Mon Dec 20 03:35:29 2021] GET /compute/v2.1/os-volumes/4b6d7970-c298-4f76-bd53-ad6068c8382a => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:35:29.534085 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-5200e074-e962-4a03-b586-0ea71a42d33b req-e939cc26-6629-41e4-9c5a-14fcf9bc1597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b572f265-bb17-4489-a53a-432eb4815ac6", "name": "network-vif-plugged", "status": "completed", "tag": "18e4f61a-85b3-4ab2-9fc5-c5bd02019210"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:35:29.536082 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:35:29.536082 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:35:29.545938 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-5200e074-e962-4a03-b586-0ea71a42d33b req-e939cc26-6629-41e4-9c5a-14fcf9bc1597 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:29.546763 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-5200e074-e962-4a03-b586-0ea71a42d33b req-e939cc26-6629-41e4-9c5a-14fcf9bc1597 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:29.571359 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-5200e074-e962-4a03-b586-0ea71a42d33b req-e939cc26-6629-41e4-9c5a-14fcf9bc1597 service nova] Creating event network-vif-plugged:18e4f61a-85b3-4ab2-9fc5-c5bd02019210 for instance b572f265-bb17-4489-a53a-432eb4815ac6 on hv-cinder-81803 Dec 20 03:35:29.578431 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-5200e074-e962-4a03-b586-0ea71a42d33b req-e939cc26-6629-41e4-9c5a-14fcf9bc1597 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049324 Dec 20 03:35:29.579076 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 464/917] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:35:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:35:29.648069 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-4b4670cb-b2b0-4315-96d7-b84b5483ebcb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:29.648770 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-4b4670cb-b2b0-4315-96d7-b84b5483ebcb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:29.657684 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4b4670cb-b2b0-4315-96d7-b84b5483ebcb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:29.658142 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4b4670cb-b2b0-4315-96d7-b84b5483ebcb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:29.659231 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4b4670cb-b2b0-4315-96d7-b84b5483ebcb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:29.659870 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4b4670cb-b2b0-4315-96d7-b84b5483ebcb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:29.711852 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-8e768bfd-0670-4f3f-a4d5-53d77d98be4c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:29.712552 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-8e768bfd-0670-4f3f-a4d5-53d77d98be4c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:29.721308 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8e768bfd-0670-4f3f-a4d5-53d77d98be4c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:29.721752 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8e768bfd-0670-4f3f-a4d5-53d77d98be4c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:29.722551 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8e768bfd-0670-4f3f-a4d5-53d77d98be4c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:29.723199 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8e768bfd-0670-4f3f-a4d5-53d77d98be4c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:29.825452 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-4b4670cb-b2b0-4315-96d7-b84b5483ebcb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:29.841745 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-4b4670cb-b2b0-4315-96d7-b84b5483ebcb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:29.843328 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-4b4670cb-b2b0-4315-96d7-b84b5483ebcb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:29.844533 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-4b4670cb-b2b0-4315-96d7-b84b5483ebcb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1750 microversion: 2.20 time: 0.200795 Dec 20 03:35:29.845698 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 454/918] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:29 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1750 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:29.958820 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-8e768bfd-0670-4f3f-a4d5-53d77d98be4c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:29.968718 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-8e768bfd-0670-4f3f-a4d5-53d77d98be4c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1266 microversion: 2.1 time: 0.261129 Dec 20 03:35:29.969399 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 465/919] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:29 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:35:30.141436 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-96a42696-97ec-416c-a662-35d60a745616 tempest-VolumesGetTestJSON-1613978294 tempest-VolumesGetTestJSON-1613978294-project] Calling method '.version_select at 0x7f49087f88b0>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:30.176615 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-96a42696-97ec-416c-a662-35d60a745616 tempest-VolumesGetTestJSON-1613978294 tempest-VolumesGetTestJSON-1613978294-project] HTTP exception thrown: Volume 4b6d7970-c298-4f76-bd53-ad6068c8382a could not be found. Dec 20 03:35:30.177257 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-96a42696-97ec-416c-a662-35d60a745616 tempest-VolumesGetTestJSON-1613978294 tempest-VolumesGetTestJSON-1613978294-project] Returning 404 to user: Volume 4b6d7970-c298-4f76-bd53-ad6068c8382a could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:35:30.178129 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-96a42696-97ec-416c-a662-35d60a745616 tempest-VolumesGetTestJSON-1613978294 tempest-VolumesGetTestJSON-1613978294-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/4b6d7970-c298-4f76-bd53-ad6068c8382a" status: 404 len: 109 microversion: 2.1 time: 0.047199 Dec 20 03:35:30.182500 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 455/920] 10.222.0.53 () {58 vars in 1244 bytes} [Mon Dec 20 03:35:30 2021] GET /compute/v2.1/os-volumes/4b6d7970-c298-4f76-bd53-ad6068c8382a => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:35:30.863206 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-97a85247-597e-4cb3-8f76-c35d7f7dc83a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:30.864543 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-97a85247-597e-4cb3-8f76-c35d7f7dc83a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:30.870515 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-97a85247-597e-4cb3-8f76-c35d7f7dc83a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:30.871046 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-97a85247-597e-4cb3-8f76-c35d7f7dc83a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:30.871964 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-97a85247-597e-4cb3-8f76-c35d7f7dc83a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:30.872475 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-97a85247-597e-4cb3-8f76-c35d7f7dc83a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:30.985068 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-939bc3af-c10b-438c-bf62-8bdfa06a6479 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:30.985895 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-939bc3af-c10b-438c-bf62-8bdfa06a6479 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:30.995963 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-939bc3af-c10b-438c-bf62-8bdfa06a6479 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:30.997205 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-939bc3af-c10b-438c-bf62-8bdfa06a6479 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:30.999718 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-939bc3af-c10b-438c-bf62-8bdfa06a6479 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:31.000287 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-939bc3af-c10b-438c-bf62-8bdfa06a6479 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:31.197817 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-939bc3af-c10b-438c-bf62-8bdfa06a6479 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:31.207279 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-939bc3af-c10b-438c-bf62-8bdfa06a6479 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1266 microversion: 2.1 time: 0.225865 Dec 20 03:35:31.209166 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 456/921] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:30 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:35:31.336592 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-97a85247-597e-4cb3-8f76-c35d7f7dc83a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:31.346060 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-97a85247-597e-4cb3-8f76-c35d7f7dc83a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:31.347635 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-97a85247-597e-4cb3-8f76-c35d7f7dc83a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:31.349046 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-97a85247-597e-4cb3-8f76-c35d7f7dc83a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1752 microversion: 2.20 time: 0.490854 Dec 20 03:35:31.361338 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 466/922] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:30 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1752 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:32.223567 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1f7d6ac9-5e71-47eb-9f89-d9cc3c1fca8e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:32.224096 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1f7d6ac9-5e71-47eb-9f89-d9cc3c1fca8e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:32.232935 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1f7d6ac9-5e71-47eb-9f89-d9cc3c1fca8e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:32.232935 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1f7d6ac9-5e71-47eb-9f89-d9cc3c1fca8e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:32.232935 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1f7d6ac9-5e71-47eb-9f89-d9cc3c1fca8e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:32.233383 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1f7d6ac9-5e71-47eb-9f89-d9cc3c1fca8e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:32.368806 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d4e736db-8b4d-4e7c-8d69-9a0428b32d4c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:32.370052 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d4e736db-8b4d-4e7c-8d69-9a0428b32d4c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:32.377543 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d4e736db-8b4d-4e7c-8d69-9a0428b32d4c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:32.378304 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d4e736db-8b4d-4e7c-8d69-9a0428b32d4c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:32.379308 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d4e736db-8b4d-4e7c-8d69-9a0428b32d4c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:32.379953 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d4e736db-8b4d-4e7c-8d69-9a0428b32d4c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:32.465993 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1f7d6ac9-5e71-47eb-9f89-d9cc3c1fca8e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:32.475893 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1f7d6ac9-5e71-47eb-9f89-d9cc3c1fca8e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1454 microversion: 2.1 time: 0.255688 Dec 20 03:35:32.476468 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 457/923] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:32 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1454 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:35:32.494564 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-3eb53586-abc3-43ad-8321-cb66d5794a6f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:32.495168 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-3eb53586-abc3-43ad-8321-cb66d5794a6f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:32.503679 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3eb53586-abc3-43ad-8321-cb66d5794a6f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:32.504654 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3eb53586-abc3-43ad-8321-cb66d5794a6f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:32.506118 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3eb53586-abc3-43ad-8321-cb66d5794a6f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:32.507110 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3eb53586-abc3-43ad-8321-cb66d5794a6f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:32.571343 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d4e736db-8b4d-4e7c-8d69-9a0428b32d4c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:32.590351 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d4e736db-8b4d-4e7c-8d69-9a0428b32d4c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:32.595633 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d4e736db-8b4d-4e7c-8d69-9a0428b32d4c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:32.596980 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d4e736db-8b4d-4e7c-8d69-9a0428b32d4c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.231766 Dec 20 03:35:32.610237 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 467/924] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:32 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:32.965709 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-3eb53586-abc3-43ad-8321-cb66d5794a6f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:32.973489 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-3eb53586-abc3-43ad-8321-cb66d5794a6f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1454 microversion: 2.1 time: 0.482560 Dec 20 03:35:32.974132 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 458/925] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:32 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1454 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:35:33.615875 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-00302882-9afe-4eee-8e4b-2156614b61a6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:33.616574 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-00302882-9afe-4eee-8e4b-2156614b61a6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:33.624222 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-00302882-9afe-4eee-8e4b-2156614b61a6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:33.624670 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-00302882-9afe-4eee-8e4b-2156614b61a6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:33.625484 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-00302882-9afe-4eee-8e4b-2156614b61a6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:33.625916 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-00302882-9afe-4eee-8e4b-2156614b61a6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:33.805857 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-00302882-9afe-4eee-8e4b-2156614b61a6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:33.815576 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-00302882-9afe-4eee-8e4b-2156614b61a6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:33.817067 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-00302882-9afe-4eee-8e4b-2156614b61a6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:33.818247 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-00302882-9afe-4eee-8e4b-2156614b61a6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.206174 Dec 20 03:35:33.819124 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 468/926] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:33 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:34.161475 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-94b84528-d815-4234-b8d0-79d2d6e66a5f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:35:34.162128 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-94b84528-d815-4234-b8d0-79d2d6e66a5f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:34.168188 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-94b84528-d815-4234-b8d0-79d2d6e66a5f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:34.168639 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-94b84528-d815-4234-b8d0-79d2d6e66a5f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:34.169568 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-94b84528-d815-4234-b8d0-79d2d6e66a5f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:34.170043 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-94b84528-d815-4234-b8d0-79d2d6e66a5f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:34.193441 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.objects.instance [None req-94b84528-d815-4234-b8d0-79d2d6e66a5f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lazy-loading 'flavor' on Instance uuid 3cc84db6-8d02-4fd4-b38c-c0a90f104993 {{(pid=117012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:35:34.622136 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-94b84528-d815-4234-b8d0-79d2d6e66a5f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "POST /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993/action" status: 202 len: 0 microversion: 2.1 time: 0.464045 Dec 20 03:35:34.623623 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 459/927] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:35:34 2021] POST /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 20 03:35:34.639053 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-952fac7d-8479-4609-a3e3-bbd16c1db52a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:34.639791 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-952fac7d-8479-4609-a3e3-bbd16c1db52a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:34.653405 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-952fac7d-8479-4609-a3e3-bbd16c1db52a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:34.654711 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-952fac7d-8479-4609-a3e3-bbd16c1db52a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:34.659380 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-952fac7d-8479-4609-a3e3-bbd16c1db52a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:34.659380 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-952fac7d-8479-4609-a3e3-bbd16c1db52a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:34.847411 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-cad164f5-f691-40aa-83ca-c939d3c6482c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:34.848390 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-cad164f5-f691-40aa-83ca-c939d3c6482c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:34.855825 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cad164f5-f691-40aa-83ca-c939d3c6482c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:34.856667 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cad164f5-f691-40aa-83ca-c939d3c6482c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:34.858662 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cad164f5-f691-40aa-83ca-c939d3c6482c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:34.859330 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cad164f5-f691-40aa-83ca-c939d3c6482c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:35.012562 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-952fac7d-8479-4609-a3e3-bbd16c1db52a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:35.024874 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-952fac7d-8479-4609-a3e3-bbd16c1db52a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.390353 Dec 20 03:35:35.026027 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 469/928] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:34 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:35:35.076662 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-cad164f5-f691-40aa-83ca-c939d3c6482c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:35.086791 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-cad164f5-f691-40aa-83ca-c939d3c6482c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:35.088863 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-cad164f5-f691-40aa-83ca-c939d3c6482c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:35.090280 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-cad164f5-f691-40aa-83ca-c939d3c6482c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.249714 Dec 20 03:35:35.095548 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 460/929] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:34 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:36.042994 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-45cb6ea3-c825-41ad-b0ec-394242ca0a3c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:36.043844 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-45cb6ea3-c825-41ad-b0ec-394242ca0a3c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:36.062477 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-45cb6ea3-c825-41ad-b0ec-394242ca0a3c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:36.063349 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-45cb6ea3-c825-41ad-b0ec-394242ca0a3c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:36.064523 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-45cb6ea3-c825-41ad-b0ec-394242ca0a3c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:36.065220 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-45cb6ea3-c825-41ad-b0ec-394242ca0a3c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:36.113282 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-4101dae3-e416-4653-9215-01d0228d2dae tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:36.113909 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-4101dae3-e416-4653-9215-01d0228d2dae tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:36.127263 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4101dae3-e416-4653-9215-01d0228d2dae tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:36.128039 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4101dae3-e416-4653-9215-01d0228d2dae tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:36.129302 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4101dae3-e416-4653-9215-01d0228d2dae tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:36.129961 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4101dae3-e416-4653-9215-01d0228d2dae tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:36.285059 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-45cb6ea3-c825-41ad-b0ec-394242ca0a3c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:36.293672 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-45cb6ea3-c825-41ad-b0ec-394242ca0a3c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.254594 Dec 20 03:35:36.305565 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 470/930] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:36 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:36.311273 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-5a619d94-c711-4cea-8426-0e954bb4b798 req-5606817b-8ca1-4de0-b2cc-d01951a38c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b572f265-bb17-4489-a53a-432eb4815ac6", "tag": "18e4f61a-85b3-4ab2-9fc5-c5bd02019210"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:35:36.313449 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:35:36.313449 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:35:36.320853 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-5a619d94-c711-4cea-8426-0e954bb4b798 req-5606817b-8ca1-4de0-b2cc-d01951a38c9e service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:36.321643 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-5a619d94-c711-4cea-8426-0e954bb4b798 req-5606817b-8ca1-4de0-b2cc-d01951a38c9e service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:36.334499 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-5a619d94-c711-4cea-8426-0e954bb4b798 req-5606817b-8ca1-4de0-b2cc-d01951a38c9e service nova] Creating event network-changed:18e4f61a-85b3-4ab2-9fc5-c5bd02019210 for instance b572f265-bb17-4489-a53a-432eb4815ac6 on hv-cinder-81803 Dec 20 03:35:36.340047 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-5a619d94-c711-4cea-8426-0e954bb4b798 req-5606817b-8ca1-4de0-b2cc-d01951a38c9e service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032876 Dec 20 03:35:36.341730 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 471/931] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:35:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:35:36.345004 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-4101dae3-e416-4653-9215-01d0228d2dae tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:36.362961 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-4101dae3-e416-4653-9215-01d0228d2dae tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:36.365537 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-4101dae3-e416-4653-9215-01d0228d2dae tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:36.367243 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-4101dae3-e416-4653-9215-01d0228d2dae tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.257664 Dec 20 03:35:36.368189 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 461/932] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:36 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:35:37.314381 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-95a1f5d6-6e6e-4f4e-8233-3e8fbc859f46 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:37.315662 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-95a1f5d6-6e6e-4f4e-8233-3e8fbc859f46 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:37.322820 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-95a1f5d6-6e6e-4f4e-8233-3e8fbc859f46 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:37.327622 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-95a1f5d6-6e6e-4f4e-8233-3e8fbc859f46 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:37.328495 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-95a1f5d6-6e6e-4f4e-8233-3e8fbc859f46 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:37.328950 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-95a1f5d6-6e6e-4f4e-8233-3e8fbc859f46 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:37.391133 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ef63542c-ce08-4f9b-8faf-b7f83ae5ef6b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:37.394178 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ef63542c-ce08-4f9b-8faf-b7f83ae5ef6b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:37.411166 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ef63542c-ce08-4f9b-8faf-b7f83ae5ef6b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:37.412242 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ef63542c-ce08-4f9b-8faf-b7f83ae5ef6b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:37.414063 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ef63542c-ce08-4f9b-8faf-b7f83ae5ef6b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:37.416551 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ef63542c-ce08-4f9b-8faf-b7f83ae5ef6b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:37.523614 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-95a1f5d6-6e6e-4f4e-8233-3e8fbc859f46 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:37.536415 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-95a1f5d6-6e6e-4f4e-8233-3e8fbc859f46 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.227526 Dec 20 03:35:37.537009 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 472/933] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:37 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:37.629774 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-ef63542c-ce08-4f9b-8faf-b7f83ae5ef6b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:37.639752 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-ef63542c-ce08-4f9b-8faf-b7f83ae5ef6b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:37.641303 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-ef63542c-ce08-4f9b-8faf-b7f83ae5ef6b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:37.642657 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ef63542c-ce08-4f9b-8faf-b7f83ae5ef6b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.255983 Dec 20 03:35:37.643398 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 462/934] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:37 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:38.553398 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a0f043f8-ac69-47f6-8557-7e97db3546a2 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:38.554626 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a0f043f8-ac69-47f6-8557-7e97db3546a2 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:38.562262 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a0f043f8-ac69-47f6-8557-7e97db3546a2 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:38.564739 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a0f043f8-ac69-47f6-8557-7e97db3546a2 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:38.564739 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a0f043f8-ac69-47f6-8557-7e97db3546a2 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:38.564739 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a0f043f8-ac69-47f6-8557-7e97db3546a2 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:38.661088 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-0d64f499-9145-48ea-9340-9e3959164bb0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:38.662220 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-0d64f499-9145-48ea-9340-9e3959164bb0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:38.671251 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0d64f499-9145-48ea-9340-9e3959164bb0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:38.673225 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0d64f499-9145-48ea-9340-9e3959164bb0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:38.674137 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0d64f499-9145-48ea-9340-9e3959164bb0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:38.675146 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0d64f499-9145-48ea-9340-9e3959164bb0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:38.775829 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-a0f043f8-ac69-47f6-8557-7e97db3546a2 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:38.809236 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a0f043f8-ac69-47f6-8557-7e97db3546a2 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.259323 Dec 20 03:35:38.818928 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 473/935] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:38 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:38.873371 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0d64f499-9145-48ea-9340-9e3959164bb0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:38.887065 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0d64f499-9145-48ea-9340-9e3959164bb0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:38.889891 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0d64f499-9145-48ea-9340-9e3959164bb0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:38.891748 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-0d64f499-9145-48ea-9340-9e3959164bb0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.234393 Dec 20 03:35:38.892795 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 463/936] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:38 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:35:39.828734 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-35b93166-4aa5-41c6-add3-91064a585e67 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:39.830282 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-35b93166-4aa5-41c6-add3-91064a585e67 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:39.837838 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-35b93166-4aa5-41c6-add3-91064a585e67 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:39.843055 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-35b93166-4aa5-41c6-add3-91064a585e67 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:39.844913 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-35b93166-4aa5-41c6-add3-91064a585e67 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:39.845608 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-35b93166-4aa5-41c6-add3-91064a585e67 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:39.912617 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-45961017-84cd-407c-8710-d841b870decd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:39.913270 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-45961017-84cd-407c-8710-d841b870decd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:39.920028 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-45961017-84cd-407c-8710-d841b870decd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:39.920752 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-45961017-84cd-407c-8710-d841b870decd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:39.922213 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-45961017-84cd-407c-8710-d841b870decd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:39.922846 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-45961017-84cd-407c-8710-d841b870decd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:40.070180 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-35b93166-4aa5-41c6-add3-91064a585e67 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:40.079933 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-35b93166-4aa5-41c6-add3-91064a585e67 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.257080 Dec 20 03:35:40.083497 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 474/937] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:39 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:40.130210 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-45961017-84cd-407c-8710-d841b870decd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:40.140582 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-45961017-84cd-407c-8710-d841b870decd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:40.142446 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-45961017-84cd-407c-8710-d841b870decd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:40.143654 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-45961017-84cd-407c-8710-d841b870decd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.235878 Dec 20 03:35:40.144410 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 464/938] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:39 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:41.101369 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-af150e5b-ed19-4916-8340-3ce56dba61e0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:41.102049 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-af150e5b-ed19-4916-8340-3ce56dba61e0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:41.109417 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-af150e5b-ed19-4916-8340-3ce56dba61e0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:41.110141 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-af150e5b-ed19-4916-8340-3ce56dba61e0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:41.111323 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-af150e5b-ed19-4916-8340-3ce56dba61e0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:41.111767 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-af150e5b-ed19-4916-8340-3ce56dba61e0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:41.161797 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-20fc8f0f-7bc2-4cdc-91ed-75ee266dd286 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:41.163202 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-20fc8f0f-7bc2-4cdc-91ed-75ee266dd286 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:41.185426 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-20fc8f0f-7bc2-4cdc-91ed-75ee266dd286 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:41.186449 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-20fc8f0f-7bc2-4cdc-91ed-75ee266dd286 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:41.191070 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-20fc8f0f-7bc2-4cdc-91ed-75ee266dd286 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:41.192301 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-20fc8f0f-7bc2-4cdc-91ed-75ee266dd286 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:41.299095 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-af150e5b-ed19-4916-8340-3ce56dba61e0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:41.309824 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-af150e5b-ed19-4916-8340-3ce56dba61e0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.212060 Dec 20 03:35:41.311268 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 475/939] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:41 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:41.444494 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-20fc8f0f-7bc2-4cdc-91ed-75ee266dd286 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:41.453983 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-20fc8f0f-7bc2-4cdc-91ed-75ee266dd286 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:41.455798 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-20fc8f0f-7bc2-4cdc-91ed-75ee266dd286 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:41.456989 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-20fc8f0f-7bc2-4cdc-91ed-75ee266dd286 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.299076 Dec 20 03:35:41.468419 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 465/940] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:41 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:42.327660 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-619024e2-6d6f-4247-91d1-61ef09231bc7 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:42.328262 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-619024e2-6d6f-4247-91d1-61ef09231bc7 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:42.334676 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-619024e2-6d6f-4247-91d1-61ef09231bc7 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:42.335123 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-619024e2-6d6f-4247-91d1-61ef09231bc7 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:42.335909 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-619024e2-6d6f-4247-91d1-61ef09231bc7 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:42.336332 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-619024e2-6d6f-4247-91d1-61ef09231bc7 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:42.483308 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-18f5cbff-0a30-4ffe-b6d4-ce96962b8b1a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:42.484079 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-18f5cbff-0a30-4ffe-b6d4-ce96962b8b1a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:42.491940 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-18f5cbff-0a30-4ffe-b6d4-ce96962b8b1a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:42.492933 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-18f5cbff-0a30-4ffe-b6d4-ce96962b8b1a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:42.493863 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-18f5cbff-0a30-4ffe-b6d4-ce96962b8b1a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:42.494399 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-18f5cbff-0a30-4ffe-b6d4-ce96962b8b1a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:42.502341 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-619024e2-6d6f-4247-91d1-61ef09231bc7 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:42.511690 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-619024e2-6d6f-4247-91d1-61ef09231bc7 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.187621 Dec 20 03:35:42.514220 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 476/941] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:42 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:42.666418 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-18f5cbff-0a30-4ffe-b6d4-ce96962b8b1a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:42.679280 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-18f5cbff-0a30-4ffe-b6d4-ce96962b8b1a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:42.683320 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-18f5cbff-0a30-4ffe-b6d4-ce96962b8b1a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:42.683320 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-18f5cbff-0a30-4ffe-b6d4-ce96962b8b1a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.209320 Dec 20 03:35:42.683320 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 466/942] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:42 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:35:43.533750 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-3972f964-aab3-4b0d-a2d2-ae0640ce59a0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:43.534473 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-3972f964-aab3-4b0d-a2d2-ae0640ce59a0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:43.542257 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3972f964-aab3-4b0d-a2d2-ae0640ce59a0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:43.542957 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3972f964-aab3-4b0d-a2d2-ae0640ce59a0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:43.544839 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3972f964-aab3-4b0d-a2d2-ae0640ce59a0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:43.545700 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3972f964-aab3-4b0d-a2d2-ae0640ce59a0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:43.697623 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-3972f964-aab3-4b0d-a2d2-ae0640ce59a0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:43.702038 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-763de012-9e0e-4b33-b022-3a1b095aa960 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:43.702655 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-763de012-9e0e-4b33-b022-3a1b095aa960 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:43.707459 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-3972f964-aab3-4b0d-a2d2-ae0640ce59a0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.179750 Dec 20 03:35:43.711878 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 477/943] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:43 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:43.712021 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-763de012-9e0e-4b33-b022-3a1b095aa960 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:43.712021 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-763de012-9e0e-4b33-b022-3a1b095aa960 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:43.712021 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-763de012-9e0e-4b33-b022-3a1b095aa960 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:43.712021 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-763de012-9e0e-4b33-b022-3a1b095aa960 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:43.856181 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-763de012-9e0e-4b33-b022-3a1b095aa960 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:43.865230 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-763de012-9e0e-4b33-b022-3a1b095aa960 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:43.866715 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-763de012-9e0e-4b33-b022-3a1b095aa960 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:43.867896 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-763de012-9e0e-4b33-b022-3a1b095aa960 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.169724 Dec 20 03:35:43.868671 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 467/944] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:43 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:44.729186 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e9a71746-8a30-4d30-a027-97e156eac345 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:44.729186 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e9a71746-8a30-4d30-a027-97e156eac345 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:44.736657 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e9a71746-8a30-4d30-a027-97e156eac345 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:44.737117 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e9a71746-8a30-4d30-a027-97e156eac345 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:44.737931 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e9a71746-8a30-4d30-a027-97e156eac345 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:44.738371 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e9a71746-8a30-4d30-a027-97e156eac345 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:44.887207 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c3dc82fe-10b7-45b2-b6b5-526bca11620a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:44.888611 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c3dc82fe-10b7-45b2-b6b5-526bca11620a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:44.891955 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-e9a71746-8a30-4d30-a027-97e156eac345 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:44.901774 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c3dc82fe-10b7-45b2-b6b5-526bca11620a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:44.902235 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c3dc82fe-10b7-45b2-b6b5-526bca11620a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:44.903068 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c3dc82fe-10b7-45b2-b6b5-526bca11620a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:44.904090 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c3dc82fe-10b7-45b2-b6b5-526bca11620a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:44.904451 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e9a71746-8a30-4d30-a027-97e156eac345 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.178321 Dec 20 03:35:44.905565 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 478/945] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:44 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:45.211391 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c3dc82fe-10b7-45b2-b6b5-526bca11620a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:45.220542 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c3dc82fe-10b7-45b2-b6b5-526bca11620a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:45.222050 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c3dc82fe-10b7-45b2-b6b5-526bca11620a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:45.223210 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c3dc82fe-10b7-45b2-b6b5-526bca11620a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.340750 Dec 20 03:35:45.224097 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 468/946] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:44 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:35:45.921379 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-8385adeb-dba4-4d49-9505-898ed7faed0c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:45.922233 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-8385adeb-dba4-4d49-9505-898ed7faed0c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:45.928497 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8385adeb-dba4-4d49-9505-898ed7faed0c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:45.928948 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8385adeb-dba4-4d49-9505-898ed7faed0c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:45.929779 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8385adeb-dba4-4d49-9505-898ed7faed0c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:45.930218 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8385adeb-dba4-4d49-9505-898ed7faed0c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:46.090450 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-8385adeb-dba4-4d49-9505-898ed7faed0c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:46.099005 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-8385adeb-dba4-4d49-9505-898ed7faed0c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.181388 Dec 20 03:35:46.099580 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 479/947] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:45 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:46.241697 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-dabd0174-9bfa-4fbb-979b-12665625d1ad tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:46.242487 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-dabd0174-9bfa-4fbb-979b-12665625d1ad tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:46.249453 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dabd0174-9bfa-4fbb-979b-12665625d1ad tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:46.252219 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dabd0174-9bfa-4fbb-979b-12665625d1ad tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:46.252219 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dabd0174-9bfa-4fbb-979b-12665625d1ad tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:46.252219 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dabd0174-9bfa-4fbb-979b-12665625d1ad tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:46.389526 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-dabd0174-9bfa-4fbb-979b-12665625d1ad tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:46.398144 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-dabd0174-9bfa-4fbb-979b-12665625d1ad tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:46.399650 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-dabd0174-9bfa-4fbb-979b-12665625d1ad tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:46.400811 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-dabd0174-9bfa-4fbb-979b-12665625d1ad tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.162895 Dec 20 03:35:46.401439 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 469/948] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:46 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:47.116797 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ba5a88f5-b99e-4dbd-ba3f-e3aec51b13a8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:47.117362 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ba5a88f5-b99e-4dbd-ba3f-e3aec51b13a8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:47.124234 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ba5a88f5-b99e-4dbd-ba3f-e3aec51b13a8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:47.124685 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ba5a88f5-b99e-4dbd-ba3f-e3aec51b13a8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:47.125512 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ba5a88f5-b99e-4dbd-ba3f-e3aec51b13a8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:47.125958 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ba5a88f5-b99e-4dbd-ba3f-e3aec51b13a8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:47.266486 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ba5a88f5-b99e-4dbd-ba3f-e3aec51b13a8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:47.274188 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ba5a88f5-b99e-4dbd-ba3f-e3aec51b13a8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.161252 Dec 20 03:35:47.274761 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 480/949] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:47 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:47.419930 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-3781dbb4-f2e6-471c-8d1b-0185bcda5598 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:47.420497 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-3781dbb4-f2e6-471c-8d1b-0185bcda5598 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:47.426720 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3781dbb4-f2e6-471c-8d1b-0185bcda5598 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:47.431016 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3781dbb4-f2e6-471c-8d1b-0185bcda5598 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:47.431016 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3781dbb4-f2e6-471c-8d1b-0185bcda5598 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:47.431016 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3781dbb4-f2e6-471c-8d1b-0185bcda5598 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:47.565998 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-3781dbb4-f2e6-471c-8d1b-0185bcda5598 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:47.574486 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-3781dbb4-f2e6-471c-8d1b-0185bcda5598 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:47.576785 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-3781dbb4-f2e6-471c-8d1b-0185bcda5598 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:47.578059 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-3781dbb4-f2e6-471c-8d1b-0185bcda5598 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.162341 Dec 20 03:35:47.578718 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 470/950] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:47 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:35:48.291450 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-037a3737-7126-424f-a45c-d393ac4d847a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:48.292055 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-037a3737-7126-424f-a45c-d393ac4d847a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:48.299503 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-037a3737-7126-424f-a45c-d393ac4d847a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:48.299930 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-037a3737-7126-424f-a45c-d393ac4d847a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:48.302746 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-037a3737-7126-424f-a45c-d393ac4d847a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:48.302746 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-037a3737-7126-424f-a45c-d393ac4d847a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:48.439047 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-037a3737-7126-424f-a45c-d393ac4d847a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:48.449249 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-037a3737-7126-424f-a45c-d393ac4d847a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.161463 Dec 20 03:35:48.449826 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 481/951] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:48 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:48.596659 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d243a73d-f7c4-41ae-9f99-e0bd5c4614df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:48.597284 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d243a73d-f7c4-41ae-9f99-e0bd5c4614df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:48.603791 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d243a73d-f7c4-41ae-9f99-e0bd5c4614df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:48.604241 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d243a73d-f7c4-41ae-9f99-e0bd5c4614df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:48.605095 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d243a73d-f7c4-41ae-9f99-e0bd5c4614df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:48.605728 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d243a73d-f7c4-41ae-9f99-e0bd5c4614df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:48.764268 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d243a73d-f7c4-41ae-9f99-e0bd5c4614df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:48.773466 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d243a73d-f7c4-41ae-9f99-e0bd5c4614df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:48.775074 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d243a73d-f7c4-41ae-9f99-e0bd5c4614df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:48.776315 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d243a73d-f7c4-41ae-9f99-e0bd5c4614df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.184025 Dec 20 03:35:48.777068 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 471/952] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:48 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:49.466433 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ece917ef-3c29-4a3d-bb4c-b540c46d1666 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:49.466985 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ece917ef-3c29-4a3d-bb4c-b540c46d1666 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:49.474865 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ece917ef-3c29-4a3d-bb4c-b540c46d1666 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:49.475315 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ece917ef-3c29-4a3d-bb4c-b540c46d1666 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:49.476111 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ece917ef-3c29-4a3d-bb4c-b540c46d1666 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:49.476557 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ece917ef-3c29-4a3d-bb4c-b540c46d1666 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:49.623113 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ece917ef-3c29-4a3d-bb4c-b540c46d1666 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:49.631367 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ece917ef-3c29-4a3d-bb4c-b540c46d1666 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.168922 Dec 20 03:35:49.631958 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 482/953] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:49 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:35:49.799854 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-212e8dad-b7ef-40cb-ba58-9970cf5cecc6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:49.799854 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-212e8dad-b7ef-40cb-ba58-9970cf5cecc6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:49.805395 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-212e8dad-b7ef-40cb-ba58-9970cf5cecc6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:49.805858 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-212e8dad-b7ef-40cb-ba58-9970cf5cecc6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:49.806664 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-212e8dad-b7ef-40cb-ba58-9970cf5cecc6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:49.807097 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-212e8dad-b7ef-40cb-ba58-9970cf5cecc6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:49.945426 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-212e8dad-b7ef-40cb-ba58-9970cf5cecc6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:49.954093 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-212e8dad-b7ef-40cb-ba58-9970cf5cecc6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:49.955658 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-212e8dad-b7ef-40cb-ba58-9970cf5cecc6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:49.956813 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-212e8dad-b7ef-40cb-ba58-9970cf5cecc6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.163499 Dec 20 03:35:49.957465 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 472/954] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:49 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:50.647633 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-25e77f1e-51f2-4742-9ccd-1de7d1c5b4f8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:50.648346 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-25e77f1e-51f2-4742-9ccd-1de7d1c5b4f8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:50.654637 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-25e77f1e-51f2-4742-9ccd-1de7d1c5b4f8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:50.655080 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-25e77f1e-51f2-4742-9ccd-1de7d1c5b4f8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:50.655925 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-25e77f1e-51f2-4742-9ccd-1de7d1c5b4f8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:50.656352 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-25e77f1e-51f2-4742-9ccd-1de7d1c5b4f8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:50.790216 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-25e77f1e-51f2-4742-9ccd-1de7d1c5b4f8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:50.799184 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-25e77f1e-51f2-4742-9ccd-1de7d1c5b4f8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.155180 Dec 20 03:35:50.805918 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 483/955] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:50 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:50.975093 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-dc614c66-3984-4ac3-a279-d3689c24ed8c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:50.975694 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-dc614c66-3984-4ac3-a279-d3689c24ed8c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:50.982560 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dc614c66-3984-4ac3-a279-d3689c24ed8c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:50.983003 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dc614c66-3984-4ac3-a279-d3689c24ed8c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:50.984659 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dc614c66-3984-4ac3-a279-d3689c24ed8c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:50.984778 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dc614c66-3984-4ac3-a279-d3689c24ed8c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:51.117652 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-dc614c66-3984-4ac3-a279-d3689c24ed8c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:51.126628 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-dc614c66-3984-4ac3-a279-d3689c24ed8c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:51.128114 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-dc614c66-3984-4ac3-a279-d3689c24ed8c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:51.129327 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-dc614c66-3984-4ac3-a279-d3689c24ed8c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.157990 Dec 20 03:35:51.129937 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 473/956] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:50 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:51.816503 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-bdd15279-832f-4fbb-8f79-bf19702b2fa8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:51.817080 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-bdd15279-832f-4fbb-8f79-bf19702b2fa8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:51.824190 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bdd15279-832f-4fbb-8f79-bf19702b2fa8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:51.829867 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bdd15279-832f-4fbb-8f79-bf19702b2fa8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:51.829867 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bdd15279-832f-4fbb-8f79-bf19702b2fa8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:51.829867 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bdd15279-832f-4fbb-8f79-bf19702b2fa8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:51.964827 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-bdd15279-832f-4fbb-8f79-bf19702b2fa8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:51.973376 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-bdd15279-832f-4fbb-8f79-bf19702b2fa8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.161438 Dec 20 03:35:51.973968 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 484/957] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:51 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:52.147274 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-41889b21-e51c-4ce9-992b-a81538dd460e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:52.147885 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-41889b21-e51c-4ce9-992b-a81538dd460e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:52.154419 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-41889b21-e51c-4ce9-992b-a81538dd460e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:52.154869 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-41889b21-e51c-4ce9-992b-a81538dd460e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:52.156374 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-41889b21-e51c-4ce9-992b-a81538dd460e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:52.156821 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-41889b21-e51c-4ce9-992b-a81538dd460e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:52.300964 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-41889b21-e51c-4ce9-992b-a81538dd460e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:52.312439 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-41889b21-e51c-4ce9-992b-a81538dd460e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:52.315579 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-41889b21-e51c-4ce9-992b-a81538dd460e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:52.315579 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-41889b21-e51c-4ce9-992b-a81538dd460e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.171968 Dec 20 03:35:52.316030 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 474/958] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:52 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:52.990782 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-10f6a2a9-9bab-4871-8a4b-be8258c59d32 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:52.991422 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-10f6a2a9-9bab-4871-8a4b-be8258c59d32 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:52.997802 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-10f6a2a9-9bab-4871-8a4b-be8258c59d32 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:52.998253 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-10f6a2a9-9bab-4871-8a4b-be8258c59d32 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:52.999373 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-10f6a2a9-9bab-4871-8a4b-be8258c59d32 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:53.000286 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-10f6a2a9-9bab-4871-8a4b-be8258c59d32 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:53.140702 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-10f6a2a9-9bab-4871-8a4b-be8258c59d32 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:53.148842 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-10f6a2a9-9bab-4871-8a4b-be8258c59d32 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.161707 Dec 20 03:35:53.149462 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 485/959] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:52 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:53.333632 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-0d6b359d-f26f-44b9-bd2f-4cb8e28f07a0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:53.334259 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-0d6b359d-f26f-44b9-bd2f-4cb8e28f07a0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:53.340514 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0d6b359d-f26f-44b9-bd2f-4cb8e28f07a0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:53.340965 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0d6b359d-f26f-44b9-bd2f-4cb8e28f07a0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:53.341769 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0d6b359d-f26f-44b9-bd2f-4cb8e28f07a0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:53.342201 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-0d6b359d-f26f-44b9-bd2f-4cb8e28f07a0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:53.492905 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0d6b359d-f26f-44b9-bd2f-4cb8e28f07a0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:53.502117 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0d6b359d-f26f-44b9-bd2f-4cb8e28f07a0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:53.503600 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-0d6b359d-f26f-44b9-bd2f-4cb8e28f07a0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:53.504759 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-0d6b359d-f26f-44b9-bd2f-4cb8e28f07a0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.174794 Dec 20 03:35:53.505386 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 475/960] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:53 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:53.534148 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-b6e4ac86-955f-48d8-856e-e89a1157c803 req-738ee963-e2d0-4713-ad4c-37d0b21fafcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1645c1-a90b-406b-ba58-0620598ecf89", "name": "network-vif-plugged", "status": "completed", "tag": "31810791-54e6-413e-889b-510ef52f5b14"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:35:53.535752 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:35:53.535752 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:35:53.542906 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-b6e4ac86-955f-48d8-856e-e89a1157c803 req-738ee963-e2d0-4713-ad4c-37d0b21fafcd service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:53.543341 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-b6e4ac86-955f-48d8-856e-e89a1157c803 req-738ee963-e2d0-4713-ad4c-37d0b21fafcd service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:53.555989 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-b6e4ac86-955f-48d8-856e-e89a1157c803 req-738ee963-e2d0-4713-ad4c-37d0b21fafcd service nova] Creating event network-vif-plugged:31810791-54e6-413e-889b-510ef52f5b14 for instance 4a1645c1-a90b-406b-ba58-0620598ecf89 on hv-cinder-81803 Dec 20 03:35:53.560758 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-b6e4ac86-955f-48d8-856e-e89a1157c803 req-738ee963-e2d0-4713-ad4c-37d0b21fafcd service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031793 Dec 20 03:35:53.561416 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 486/961] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:35:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:35:54.167735 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d36d60a7-f4cd-4eac-978b-ec5d2f847906 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:54.168504 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d36d60a7-f4cd-4eac-978b-ec5d2f847906 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:54.175045 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d36d60a7-f4cd-4eac-978b-ec5d2f847906 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:54.175490 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d36d60a7-f4cd-4eac-978b-ec5d2f847906 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:54.176272 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d36d60a7-f4cd-4eac-978b-ec5d2f847906 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:54.177476 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d36d60a7-f4cd-4eac-978b-ec5d2f847906 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:54.353495 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d36d60a7-f4cd-4eac-978b-ec5d2f847906 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:54.361427 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d36d60a7-f4cd-4eac-978b-ec5d2f847906 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.198130 Dec 20 03:35:54.361997 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 476/962] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:54 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:54.536591 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-4765626f-7258-478d-8db6-3bb9c28d0001 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:54.537319 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-4765626f-7258-478d-8db6-3bb9c28d0001 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:54.544904 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4765626f-7258-478d-8db6-3bb9c28d0001 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:54.545498 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4765626f-7258-478d-8db6-3bb9c28d0001 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:54.550889 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4765626f-7258-478d-8db6-3bb9c28d0001 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:54.550889 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4765626f-7258-478d-8db6-3bb9c28d0001 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:54.685797 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-4765626f-7258-478d-8db6-3bb9c28d0001 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:54.695611 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-4765626f-7258-478d-8db6-3bb9c28d0001 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:54.697415 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-4765626f-7258-478d-8db6-3bb9c28d0001 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:54.698584 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-4765626f-7258-478d-8db6-3bb9c28d0001 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.167345 Dec 20 03:35:54.699157 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 487/963] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:54 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:55.380008 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-947999d7-7495-40d1-b7b4-e645876a5e8d tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:55.380618 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-947999d7-7495-40d1-b7b4-e645876a5e8d tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:55.387024 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-947999d7-7495-40d1-b7b4-e645876a5e8d tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:55.387466 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-947999d7-7495-40d1-b7b4-e645876a5e8d tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:55.388239 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-947999d7-7495-40d1-b7b4-e645876a5e8d tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:55.388672 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-947999d7-7495-40d1-b7b4-e645876a5e8d tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:55.527467 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-947999d7-7495-40d1-b7b4-e645876a5e8d tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:55.536022 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-947999d7-7495-40d1-b7b4-e645876a5e8d tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.162042 Dec 20 03:35:55.536611 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 477/964] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:55 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:35:55.716796 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1ae9a13b-8af5-4a56-a942-6437bb0f3a54 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:55.718178 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1ae9a13b-8af5-4a56-a942-6437bb0f3a54 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:55.726593 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1ae9a13b-8af5-4a56-a942-6437bb0f3a54 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:55.726994 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1ae9a13b-8af5-4a56-a942-6437bb0f3a54 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:55.727774 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1ae9a13b-8af5-4a56-a942-6437bb0f3a54 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:55.728263 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1ae9a13b-8af5-4a56-a942-6437bb0f3a54 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:55.873533 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-1ae9a13b-8af5-4a56-a942-6437bb0f3a54 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:55.882838 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-1ae9a13b-8af5-4a56-a942-6437bb0f3a54 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:55.884348 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-1ae9a13b-8af5-4a56-a942-6437bb0f3a54 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:55.885577 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1ae9a13b-8af5-4a56-a942-6437bb0f3a54 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.172430 Dec 20 03:35:55.886174 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 488/965] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:55 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:56.553863 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-2c1edc00-f21a-4327-a133-541d546e8a23 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:56.554458 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-2c1edc00-f21a-4327-a133-541d546e8a23 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:56.560796 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2c1edc00-f21a-4327-a133-541d546e8a23 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:56.561366 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2c1edc00-f21a-4327-a133-541d546e8a23 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:56.562154 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2c1edc00-f21a-4327-a133-541d546e8a23 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:56.563156 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2c1edc00-f21a-4327-a133-541d546e8a23 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:56.707838 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-2c1edc00-f21a-4327-a133-541d546e8a23 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:56.715506 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-2c1edc00-f21a-4327-a133-541d546e8a23 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.165286 Dec 20 03:35:56.716309 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 478/966] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:56 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:56.903695 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-3df4870e-5b45-478a-a97e-4f14f024f953 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:56.904236 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-3df4870e-5b45-478a-a97e-4f14f024f953 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:56.912245 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3df4870e-5b45-478a-a97e-4f14f024f953 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:56.912769 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3df4870e-5b45-478a-a97e-4f14f024f953 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:56.913645 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3df4870e-5b45-478a-a97e-4f14f024f953 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:56.917113 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3df4870e-5b45-478a-a97e-4f14f024f953 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:57.100020 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-3df4870e-5b45-478a-a97e-4f14f024f953 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:57.114017 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-3df4870e-5b45-478a-a97e-4f14f024f953 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:57.115761 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-3df4870e-5b45-478a-a97e-4f14f024f953 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:57.117052 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-3df4870e-5b45-478a-a97e-4f14f024f953 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1808 microversion: 2.20 time: 0.217159 Dec 20 03:35:57.117662 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 489/967] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:56 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:57.733357 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-99b41c95-2d7b-4cfb-ae58-145439404b1a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:57.733872 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-99b41c95-2d7b-4cfb-ae58-145439404b1a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:57.740877 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-99b41c95-2d7b-4cfb-ae58-145439404b1a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:57.744360 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-99b41c95-2d7b-4cfb-ae58-145439404b1a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:57.744360 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-99b41c95-2d7b-4cfb-ae58-145439404b1a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:57.744360 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-99b41c95-2d7b-4cfb-ae58-145439404b1a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:57.878872 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-99b41c95-2d7b-4cfb-ae58-145439404b1a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:57.886515 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-99b41c95-2d7b-4cfb-ae58-145439404b1a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.156979 Dec 20 03:35:57.887161 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 479/968] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:57 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:58.139879 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-3aacd9b7-b3dc-40b1-833d-60d4693f098b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:58.140557 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-3aacd9b7-b3dc-40b1-833d-60d4693f098b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:58.147412 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3aacd9b7-b3dc-40b1-833d-60d4693f098b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:58.147865 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3aacd9b7-b3dc-40b1-833d-60d4693f098b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:58.148831 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3aacd9b7-b3dc-40b1-833d-60d4693f098b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:58.149292 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3aacd9b7-b3dc-40b1-833d-60d4693f098b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:58.299768 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-3aacd9b7-b3dc-40b1-833d-60d4693f098b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:58.308294 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-3aacd9b7-b3dc-40b1-833d-60d4693f098b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:58.309814 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-3aacd9b7-b3dc-40b1-833d-60d4693f098b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:58.311010 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-3aacd9b7-b3dc-40b1-833d-60d4693f098b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1795 microversion: 2.20 time: 0.174913 Dec 20 03:35:58.311556 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 490/969] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:35:58 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1795 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:35:58.904037 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c43f2196-ad2a-4fc0-a425-d58225d308ad tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:58.904747 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c43f2196-ad2a-4fc0-a425-d58225d308ad tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:58.911665 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c43f2196-ad2a-4fc0-a425-d58225d308ad tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:58.912119 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c43f2196-ad2a-4fc0-a425-d58225d308ad tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:58.912910 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c43f2196-ad2a-4fc0-a425-d58225d308ad tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:58.913380 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c43f2196-ad2a-4fc0-a425-d58225d308ad tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:59.052819 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c43f2196-ad2a-4fc0-a425-d58225d308ad tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:59.060561 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c43f2196-ad2a-4fc0-a425-d58225d308ad tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1507 microversion: 2.1 time: 0.160244 Dec 20 03:35:59.061125 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 480/970] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:58 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:35:59.080186 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-c41d3af0-91a9-4a51-bed9-a5635250e927 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:35:59.080764 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-c41d3af0-91a9-4a51-bed9-a5635250e927 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:59.086922 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c41d3af0-91a9-4a51-bed9-a5635250e927 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:59.087369 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c41d3af0-91a9-4a51-bed9-a5635250e927 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:59.088201 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c41d3af0-91a9-4a51-bed9-a5635250e927 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:59.088635 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c41d3af0-91a9-4a51-bed9-a5635250e927 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:59.287527 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-c41d3af0-91a9-4a51-bed9-a5635250e927 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "POST /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993/action" status: 202 len: 0 microversion: 2.1 time: 0.212426 Dec 20 03:35:59.288313 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 491/971] 10.222.0.53 () {60 vars in 1277 bytes} [Mon Dec 20 03:35:59 2021] POST /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:35:59.296112 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-07c47354-a840-4904-a960-98aef8ee18fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:35:59.296897 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-07c47354-a840-4904-a960-98aef8ee18fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:35:59.305546 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-07c47354-a840-4904-a960-98aef8ee18fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:59.306348 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-07c47354-a840-4904-a960-98aef8ee18fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:59.307434 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-07c47354-a840-4904-a960-98aef8ee18fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:35:59.309072 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-07c47354-a840-4904-a960-98aef8ee18fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:35:59.458394 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-07c47354-a840-4904-a960-98aef8ee18fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:35:59.466977 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-07c47354-a840-4904-a960-98aef8ee18fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1515 microversion: 2.1 time: 0.174352 Dec 20 03:35:59.467910 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 481/972] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:35:59 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:00.487248 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-40ed5ac3-161b-41fa-aaed-402e2d10b975 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:00.487966 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-40ed5ac3-161b-41fa-aaed-402e2d10b975 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:00.494021 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-40ed5ac3-161b-41fa-aaed-402e2d10b975 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:00.494496 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-40ed5ac3-161b-41fa-aaed-402e2d10b975 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:00.498492 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-40ed5ac3-161b-41fa-aaed-402e2d10b975 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:00.498492 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-40ed5ac3-161b-41fa-aaed-402e2d10b975 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:00.647927 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-40ed5ac3-161b-41fa-aaed-402e2d10b975 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:00.664570 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-40ed5ac3-161b-41fa-aaed-402e2d10b975 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1517 microversion: 2.1 time: 0.182427 Dec 20 03:36:00.665745 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 492/973] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:00 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1517 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:01.491510 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-7cf757aa-0284-4790-85b0-f8bbcf1b8504 req-5d64f72d-a2ab-48aa-905f-1712036f38e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc84db6-8d02-4fd4-b38c-c0a90f104993", "name": "network-vif-unplugged", "status": "completed", "tag": "dcafb0f8-ea15-4cf6-ace1-0817393056e3"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:36:01.495851 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:36:01.495851 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:36:01.511545 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-7cf757aa-0284-4790-85b0-f8bbcf1b8504 req-5d64f72d-a2ab-48aa-905f-1712036f38e5 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:01.512325 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-7cf757aa-0284-4790-85b0-f8bbcf1b8504 req-5d64f72d-a2ab-48aa-905f-1712036f38e5 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:01.534683 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.compute.server_external_events [req-7cf757aa-0284-4790-85b0-f8bbcf1b8504 req-5d64f72d-a2ab-48aa-905f-1712036f38e5 service nova] Unable to find a host for instance 3cc84db6-8d02-4fd4-b38c-c0a90f104993. Dropping event network-vif-unplugged {{(pid=117012) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 20 03:36:01.536092 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-7cf757aa-0284-4790-85b0-f8bbcf1b8504 req-5d64f72d-a2ab-48aa-905f-1712036f38e5 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.053027 Dec 20 03:36:01.537178 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 482/974] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:36:01 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 20 03:36:01.683461 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-eae3ac66-4057-4146-b6e5-6283a3350b39 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:01.684179 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-eae3ac66-4057-4146-b6e5-6283a3350b39 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:01.692065 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eae3ac66-4057-4146-b6e5-6283a3350b39 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:01.692757 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eae3ac66-4057-4146-b6e5-6283a3350b39 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:01.693783 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eae3ac66-4057-4146-b6e5-6283a3350b39 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:01.694566 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eae3ac66-4057-4146-b6e5-6283a3350b39 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:01.830589 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-eae3ac66-4057-4146-b6e5-6283a3350b39 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:01.841971 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-eae3ac66-4057-4146-b6e5-6283a3350b39 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1517 microversion: 2.1 time: 0.162083 Dec 20 03:36:01.842463 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 493/975] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:01 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:02.859324 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-b7a9f841-aa58-49b1-a63b-0632e68b1026 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:02.860422 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-b7a9f841-aa58-49b1-a63b-0632e68b1026 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:02.866562 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b7a9f841-aa58-49b1-a63b-0632e68b1026 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:02.867174 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b7a9f841-aa58-49b1-a63b-0632e68b1026 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:02.867962 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b7a9f841-aa58-49b1-a63b-0632e68b1026 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:02.868412 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b7a9f841-aa58-49b1-a63b-0632e68b1026 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:03.096585 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-b7a9f841-aa58-49b1-a63b-0632e68b1026 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:03.104574 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-b7a9f841-aa58-49b1-a63b-0632e68b1026 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1573 microversion: 2.1 time: 0.248881 Dec 20 03:36:03.115518 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 483/976] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:02 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1573 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:03.263974 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a27ec61a-2b52-4d5f-ab8f-3ed3e22e95de tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1674769746", "imageRef": "9c4ec443-915b-4997-82d3-08cc97ba635b", "flavorRef": "452", "networks": [{"uuid": "756124ed-9b1d-42f9-9b67-504c14da1547"}]}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:36:03.326015 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.network.neutron [None req-a27ec61a-2b52-4d5f-ab8f-3ed3e22e95de tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] validate_networks() for [('756124ed-9b1d-42f9-9b67-504c14da1547', None, None, None, None, None)] {{(pid=117011) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:36:03.684382 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-a27ec61a-2b52-4d5f-ab8f-3ed3e22e95de tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Flavor limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:36:03.684811 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-a27ec61a-2b52-4d5f-ab8f-3ed3e22e95de tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Image limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:36:03.685352 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-a27ec61a-2b52-4d5f-ab8f-3ed3e22e95de tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Flavor pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:36:03.685764 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-a27ec61a-2b52-4d5f-ab8f-3ed3e22e95de tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Image pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:36:03.686179 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-a27ec61a-2b52-4d5f-ab8f-3ed3e22e95de tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:36:03.695965 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a27ec61a-2b52-4d5f-ab8f-3ed3e22e95de tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:03.696468 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a27ec61a-2b52-4d5f-ab8f-3ed3e22e95de tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:03.697322 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a27ec61a-2b52-4d5f-ab8f-3ed3e22e95de tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:03.701657 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a27ec61a-2b52-4d5f-ab8f-3ed3e22e95de tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:03.714328 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-a27ec61a-2b52-4d5f-ab8f-3ed3e22e95de tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Getting quotas for project 4c82837589244f669a18d91e30105e14. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:36:03.718224 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-a27ec61a-2b52-4d5f-ab8f-3ed3e22e95de tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Getting quotas for user 5cfe2917349e43448f38bf960db4bc42 and project 4c82837589244f669a18d91e30105e14. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:36:03.729086 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a27ec61a-2b52-4d5f-ab8f-3ed3e22e95de tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Going to run 1 instances... {{(pid=117011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:36:03.731455 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a27ec61a-2b52-4d5f-ab8f-3ed3e22e95de tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: e7dba9b8-ff69-4964-bfdb-9d3bf4d57886] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c4ec443-915b-4997-82d3-08cc97ba635b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:36:03.836358 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a27ec61a-2b52-4d5f-ab8f-3ed3e22e95de tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575786 Dec 20 03:36:03.841596 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 494/977] 10.222.0.53 () {60 vars in 1146 bytes} [Mon Dec 20 03:36:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 03:36:03.848137 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-8483bb09-cbb9-417c-8c5e-1bfbad793b6d tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:03.848759 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-8483bb09-cbb9-417c-8c5e-1bfbad793b6d tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: e7dba9b8-ff69-4964-bfdb-9d3bf4d57886] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:03.902080 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-8483bb09-cbb9-417c-8c5e-1bfbad793b6d tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:03.909297 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-8483bb09-cbb9-417c-8c5e-1bfbad793b6d tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886" status: 200 len: 1214 microversion: 2.1 time: 0.065226 Dec 20 03:36:03.910071 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 484/978] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:03 2021] GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:04.123132 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-c1d70e51-034a-430b-82d6-b6cd8e65d586 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:04.123657 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-c1d70e51-034a-430b-82d6-b6cd8e65d586 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:04.130686 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c1d70e51-034a-430b-82d6-b6cd8e65d586 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:04.131132 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c1d70e51-034a-430b-82d6-b6cd8e65d586 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:04.131904 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c1d70e51-034a-430b-82d6-b6cd8e65d586 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:04.132336 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c1d70e51-034a-430b-82d6-b6cd8e65d586 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:04.271960 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-c1d70e51-034a-430b-82d6-b6cd8e65d586 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:04.280783 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-c1d70e51-034a-430b-82d6-b6cd8e65d586 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1573 microversion: 2.1 time: 0.161652 Dec 20 03:36:04.281473 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 495/979] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:04 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:04.926113 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d0f14a0e-9d21-4472-8165-3506391b0073 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:04.926751 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d0f14a0e-9d21-4472-8165-3506391b0073 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: e7dba9b8-ff69-4964-bfdb-9d3bf4d57886] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:04.934167 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d0f14a0e-9d21-4472-8165-3506391b0073 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:04.934618 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d0f14a0e-9d21-4472-8165-3506391b0073 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:04.935411 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d0f14a0e-9d21-4472-8165-3506391b0073 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:04.935852 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d0f14a0e-9d21-4472-8165-3506391b0073 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:05.000680 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d0f14a0e-9d21-4472-8165-3506391b0073 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:05.008471 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d0f14a0e-9d21-4472-8165-3506391b0073 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886" status: 200 len: 1218 microversion: 2.1 time: 0.086163 Dec 20 03:36:05.009055 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 485/980] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:04 2021] GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:05.297904 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-658bc618-2bdd-43a7-8fa9-0049a339cd40 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:05.298464 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-658bc618-2bdd-43a7-8fa9-0049a339cd40 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:05.304891 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-658bc618-2bdd-43a7-8fa9-0049a339cd40 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:05.305687 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-658bc618-2bdd-43a7-8fa9-0049a339cd40 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:05.306497 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-658bc618-2bdd-43a7-8fa9-0049a339cd40 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:05.306910 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-658bc618-2bdd-43a7-8fa9-0049a339cd40 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:05.452718 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-658bc618-2bdd-43a7-8fa9-0049a339cd40 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:05.461434 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-658bc618-2bdd-43a7-8fa9-0049a339cd40 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1573 microversion: 2.1 time: 0.167307 Dec 20 03:36:05.462028 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 496/981] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:05 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:06.025582 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-b557d22c-e58c-4871-a0bb-3121c9d3c716 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:06.026215 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-b557d22c-e58c-4871-a0bb-3121c9d3c716 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: e7dba9b8-ff69-4964-bfdb-9d3bf4d57886] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:06.033045 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b557d22c-e58c-4871-a0bb-3121c9d3c716 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:06.033518 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b557d22c-e58c-4871-a0bb-3121c9d3c716 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:06.034288 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b557d22c-e58c-4871-a0bb-3121c9d3c716 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:06.034723 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b557d22c-e58c-4871-a0bb-3121c9d3c716 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:06.095654 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-b557d22c-e58c-4871-a0bb-3121c9d3c716 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:06.104904 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-b557d22c-e58c-4871-a0bb-3121c9d3c716 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886" status: 200 len: 1266 microversion: 2.1 time: 0.083009 Dec 20 03:36:06.105495 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 486/982] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:06 2021] GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:06.480757 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-19bb58f8-c0a8-41e4-9d0f-5c1a489b97da tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:06.481815 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-19bb58f8-c0a8-41e4-9d0f-5c1a489b97da tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:06.492359 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-19bb58f8-c0a8-41e4-9d0f-5c1a489b97da tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:06.492802 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-19bb58f8-c0a8-41e4-9d0f-5c1a489b97da tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:06.493846 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-19bb58f8-c0a8-41e4-9d0f-5c1a489b97da tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:06.494446 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-19bb58f8-c0a8-41e4-9d0f-5c1a489b97da tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:06.638057 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-19bb58f8-c0a8-41e4-9d0f-5c1a489b97da tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:06.647803 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-19bb58f8-c0a8-41e4-9d0f-5c1a489b97da tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1573 microversion: 2.1 time: 0.172143 Dec 20 03:36:06.648680 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 497/983] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:06 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:07.123529 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-b902bb4d-fee1-4d73-a8b2-aea2add8cddb tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:07.124494 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-b902bb4d-fee1-4d73-a8b2-aea2add8cddb tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: e7dba9b8-ff69-4964-bfdb-9d3bf4d57886] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:07.131598 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b902bb4d-fee1-4d73-a8b2-aea2add8cddb tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:07.132054 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b902bb4d-fee1-4d73-a8b2-aea2add8cddb tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:07.132876 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b902bb4d-fee1-4d73-a8b2-aea2add8cddb tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:07.133358 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b902bb4d-fee1-4d73-a8b2-aea2add8cddb tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:07.350201 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-b902bb4d-fee1-4d73-a8b2-aea2add8cddb tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:07.357950 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-b902bb4d-fee1-4d73-a8b2-aea2add8cddb tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886" status: 200 len: 1314 microversion: 2.1 time: 0.238023 Dec 20 03:36:07.358681 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 487/984] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:07 2021] GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:07.665272 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-60c13471-5335-48f2-91f9-a2f2dfcca555 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:07.665885 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-60c13471-5335-48f2-91f9-a2f2dfcca555 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:07.672987 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-60c13471-5335-48f2-91f9-a2f2dfcca555 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:07.673461 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-60c13471-5335-48f2-91f9-a2f2dfcca555 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:07.674245 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-60c13471-5335-48f2-91f9-a2f2dfcca555 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:07.674676 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-60c13471-5335-48f2-91f9-a2f2dfcca555 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:07.823500 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-60c13471-5335-48f2-91f9-a2f2dfcca555 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:07.832198 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-60c13471-5335-48f2-91f9-a2f2dfcca555 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1573 microversion: 2.1 time: 0.170496 Dec 20 03:36:07.832783 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 498/985] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:07 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:08.018086 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-c0d28865-810a-4efb-96e2-3960129bc304 req-50aa9372-63b9-4e51-bef3-04da0c39e1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7dba9b8-ff69-4964-bfdb-9d3bf4d57886", "tag": "bc075a73-a26f-477b-ba75-113f1643c36d"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:36:08.027085 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:36:08.027085 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:36:08.034962 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-c0d28865-810a-4efb-96e2-3960129bc304 req-50aa9372-63b9-4e51-bef3-04da0c39e1a1 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:08.035390 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-c0d28865-810a-4efb-96e2-3960129bc304 req-50aa9372-63b9-4e51-bef3-04da0c39e1a1 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:08.047882 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-c0d28865-810a-4efb-96e2-3960129bc304 req-50aa9372-63b9-4e51-bef3-04da0c39e1a1 service nova] Creating event network-changed:bc075a73-a26f-477b-ba75-113f1643c36d for instance e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 on hv-cinder-81803 Dec 20 03:36:08.052890 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-c0d28865-810a-4efb-96e2-3960129bc304 req-50aa9372-63b9-4e51-bef3-04da0c39e1a1 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038612 Dec 20 03:36:08.053732 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 488/986] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:36:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:36:08.375436 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f52e7d4d-21f7-4271-88b1-402aebcdff89 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:08.376039 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-f52e7d4d-21f7-4271-88b1-402aebcdff89 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: e7dba9b8-ff69-4964-bfdb-9d3bf4d57886] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:08.382916 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f52e7d4d-21f7-4271-88b1-402aebcdff89 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:08.383363 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f52e7d4d-21f7-4271-88b1-402aebcdff89 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:08.384153 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f52e7d4d-21f7-4271-88b1-402aebcdff89 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:08.384588 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f52e7d4d-21f7-4271-88b1-402aebcdff89 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:08.542024 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-f52e7d4d-21f7-4271-88b1-402aebcdff89 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:08.555449 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f52e7d4d-21f7-4271-88b1-402aebcdff89 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886" status: 200 len: 1314 microversion: 2.1 time: 0.183794 Dec 20 03:36:08.556391 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 499/987] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:08 2021] GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:08.854626 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-2e1f91c3-0518-4bd2-add6-e710e888468f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:08.855975 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-2e1f91c3-0518-4bd2-add6-e710e888468f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:08.864632 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2e1f91c3-0518-4bd2-add6-e710e888468f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:08.865083 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2e1f91c3-0518-4bd2-add6-e710e888468f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:08.866032 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2e1f91c3-0518-4bd2-add6-e710e888468f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:08.866336 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2e1f91c3-0518-4bd2-add6-e710e888468f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:09.017549 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-2e1f91c3-0518-4bd2-add6-e710e888468f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:09.025901 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-2e1f91c3-0518-4bd2-add6-e710e888468f tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1573 microversion: 2.1 time: 0.178214 Dec 20 03:36:09.026483 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 489/988] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:08 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1573 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:09.582044 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-4b5b380d-077b-4ccc-8436-51b9935e85f3 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:09.583081 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-4b5b380d-077b-4ccc-8436-51b9935e85f3 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: e7dba9b8-ff69-4964-bfdb-9d3bf4d57886] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:09.591363 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4b5b380d-077b-4ccc-8436-51b9935e85f3 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:09.591817 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4b5b380d-077b-4ccc-8436-51b9935e85f3 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:09.592621 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4b5b380d-077b-4ccc-8436-51b9935e85f3 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:09.593058 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4b5b380d-077b-4ccc-8436-51b9935e85f3 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:09.739510 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-4b5b380d-077b-4ccc-8436-51b9935e85f3 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:09.747394 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-4b5b380d-077b-4ccc-8436-51b9935e85f3 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886" status: 200 len: 1314 microversion: 2.1 time: 0.170849 Dec 20 03:36:09.747970 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 500/989] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:09 2021] GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:36:10.051238 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-22d30f75-6a7f-44e3-a068-0df604036ed0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:10.051853 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-22d30f75-6a7f-44e3-a068-0df604036ed0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:10.058231 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-22d30f75-6a7f-44e3-a068-0df604036ed0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:10.058679 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-22d30f75-6a7f-44e3-a068-0df604036ed0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:10.059470 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-22d30f75-6a7f-44e3-a068-0df604036ed0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:10.059903 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-22d30f75-6a7f-44e3-a068-0df604036ed0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:10.212169 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-22d30f75-6a7f-44e3-a068-0df604036ed0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:10.223554 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-22d30f75-6a7f-44e3-a068-0df604036ed0 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1573 microversion: 2.1 time: 0.175828 Dec 20 03:36:10.224553 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 490/990] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:10 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1573 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:10.766528 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-2ee74294-8e26-4677-9450-ed94e2c712d6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:10.767076 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-2ee74294-8e26-4677-9450-ed94e2c712d6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: e7dba9b8-ff69-4964-bfdb-9d3bf4d57886] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:10.773308 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2ee74294-8e26-4677-9450-ed94e2c712d6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:10.773764 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2ee74294-8e26-4677-9450-ed94e2c712d6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:10.774539 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2ee74294-8e26-4677-9450-ed94e2c712d6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:10.774965 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2ee74294-8e26-4677-9450-ed94e2c712d6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:10.912839 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-2ee74294-8e26-4677-9450-ed94e2c712d6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:10.920314 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-2ee74294-8e26-4677-9450-ed94e2c712d6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886" status: 200 len: 1314 microversion: 2.1 time: 0.158606 Dec 20 03:36:10.920872 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 501/991] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:10 2021] GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:36:11.241791 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a2f0c2c3-6a54-46e1-ac67-7552558a9f14 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:11.242409 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a2f0c2c3-6a54-46e1-ac67-7552558a9f14 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:11.248780 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a2f0c2c3-6a54-46e1-ac67-7552558a9f14 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:11.249532 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a2f0c2c3-6a54-46e1-ac67-7552558a9f14 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:11.250382 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a2f0c2c3-6a54-46e1-ac67-7552558a9f14 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:11.250822 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a2f0c2c3-6a54-46e1-ac67-7552558a9f14 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:11.386716 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-a2f0c2c3-6a54-46e1-ac67-7552558a9f14 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:11.394783 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a2f0c2c3-6a54-46e1-ac67-7552558a9f14 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1573 microversion: 2.1 time: 0.156873 Dec 20 03:36:11.395366 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 491/992] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:11 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:36:11.938224 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d44887c1-0cf7-4555-84aa-455abdb43fd6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:11.939088 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d44887c1-0cf7-4555-84aa-455abdb43fd6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: e7dba9b8-ff69-4964-bfdb-9d3bf4d57886] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:11.945504 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d44887c1-0cf7-4555-84aa-455abdb43fd6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:11.945951 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d44887c1-0cf7-4555-84aa-455abdb43fd6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:11.946744 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d44887c1-0cf7-4555-84aa-455abdb43fd6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:11.947259 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d44887c1-0cf7-4555-84aa-455abdb43fd6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:12.088647 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d44887c1-0cf7-4555-84aa-455abdb43fd6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:12.096487 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d44887c1-0cf7-4555-84aa-455abdb43fd6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886" status: 200 len: 1314 microversion: 2.1 time: 0.161949 Dec 20 03:36:12.097082 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 502/993] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:11 2021] GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:12.413632 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-640a7d89-bd31-40e9-af7d-698e43f9fe78 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:12.414657 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-640a7d89-bd31-40e9-af7d-698e43f9fe78 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:12.423702 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-640a7d89-bd31-40e9-af7d-698e43f9fe78 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:12.424425 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-640a7d89-bd31-40e9-af7d-698e43f9fe78 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:12.425721 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-640a7d89-bd31-40e9-af7d-698e43f9fe78 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:12.426317 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-640a7d89-bd31-40e9-af7d-698e43f9fe78 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:12.599159 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-640a7d89-bd31-40e9-af7d-698e43f9fe78 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:12.607742 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-640a7d89-bd31-40e9-af7d-698e43f9fe78 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1573 microversion: 2.1 time: 0.199300 Dec 20 03:36:12.608422 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 492/994] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:12 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1573 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:13.112303 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e024b605-0087-41b7-8b28-39e004835e02 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:13.112892 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e024b605-0087-41b7-8b28-39e004835e02 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: e7dba9b8-ff69-4964-bfdb-9d3bf4d57886] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:13.119299 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e024b605-0087-41b7-8b28-39e004835e02 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:13.119735 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e024b605-0087-41b7-8b28-39e004835e02 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:13.120511 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e024b605-0087-41b7-8b28-39e004835e02 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:13.120937 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e024b605-0087-41b7-8b28-39e004835e02 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:13.275685 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-e024b605-0087-41b7-8b28-39e004835e02 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:13.284461 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e024b605-0087-41b7-8b28-39e004835e02 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886" status: 200 len: 1314 microversion: 2.1 time: 0.175941 Dec 20 03:36:13.285064 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 503/995] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:13 2021] GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:36:13.632033 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-eb2335c0-f433-4651-b47a-45f11179a227 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:13.632739 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-eb2335c0-f433-4651-b47a-45f11179a227 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:13.639635 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-eb2335c0-f433-4651-b47a-45f11179a227 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:13.640150 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-eb2335c0-f433-4651-b47a-45f11179a227 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:13.641665 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-eb2335c0-f433-4651-b47a-45f11179a227 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:13.642105 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-eb2335c0-f433-4651-b47a-45f11179a227 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:13.663533 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-2ee23e88-7d15-43bc-b838-ba457565bdbc req-e051c70b-0b46-4703-aa40-f1e0ed2ad6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7dba9b8-ff69-4964-bfdb-9d3bf4d57886", "name": "network-vif-plugged", "status": "completed", "tag": "bc075a73-a26f-477b-ba75-113f1643c36d"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:36:13.665231 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:36:13.665231 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:36:13.672738 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-2ee23e88-7d15-43bc-b838-ba457565bdbc req-e051c70b-0b46-4703-aa40-f1e0ed2ad6b2 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:13.676729 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-2ee23e88-7d15-43bc-b838-ba457565bdbc req-e051c70b-0b46-4703-aa40-f1e0ed2ad6b2 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:13.684662 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-2ee23e88-7d15-43bc-b838-ba457565bdbc req-e051c70b-0b46-4703-aa40-f1e0ed2ad6b2 service nova] Creating event network-vif-plugged:bc075a73-a26f-477b-ba75-113f1643c36d for instance e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 on hv-cinder-81803 Dec 20 03:36:13.691756 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-2ee23e88-7d15-43bc-b838-ba457565bdbc req-e051c70b-0b46-4703-aa40-f1e0ed2ad6b2 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031570 Dec 20 03:36:13.692817 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 504/996] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:36:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:36:13.835248 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-eb2335c0-f433-4651-b47a-45f11179a227 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:13.844101 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-eb2335c0-f433-4651-b47a-45f11179a227 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1573 microversion: 2.1 time: 0.220790 Dec 20 03:36:13.845042 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 493/997] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:13 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1573 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:14.305169 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-691e732d-d116-4721-ab79-534ab7080250 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:14.305850 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-691e732d-d116-4721-ab79-534ab7080250 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: e7dba9b8-ff69-4964-bfdb-9d3bf4d57886] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:14.313538 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-691e732d-d116-4721-ab79-534ab7080250 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:14.313980 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-691e732d-d116-4721-ab79-534ab7080250 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:14.314805 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-691e732d-d116-4721-ab79-534ab7080250 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:14.315332 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-691e732d-d116-4721-ab79-534ab7080250 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:14.455791 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-691e732d-d116-4721-ab79-534ab7080250 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:14.463241 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-691e732d-d116-4721-ab79-534ab7080250 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886" status: 200 len: 1314 microversion: 2.1 time: 0.163124 Dec 20 03:36:14.464104 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 505/998] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:14 2021] GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:14.861979 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-652a4b65-3409-408d-b4e3-7cbfa5174fd8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:14.862614 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-652a4b65-3409-408d-b4e3-7cbfa5174fd8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:14.869328 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-652a4b65-3409-408d-b4e3-7cbfa5174fd8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:14.869785 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-652a4b65-3409-408d-b4e3-7cbfa5174fd8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:14.870570 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-652a4b65-3409-408d-b4e3-7cbfa5174fd8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:14.871001 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-652a4b65-3409-408d-b4e3-7cbfa5174fd8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:15.030252 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-652a4b65-3409-408d-b4e3-7cbfa5174fd8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:15.039147 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-652a4b65-3409-408d-b4e3-7cbfa5174fd8 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1573 microversion: 2.1 time: 0.181526 Dec 20 03:36:15.039731 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 494/999] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:14 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1573 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:15.481986 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-dfb0a234-1322-404e-886c-15ed1a0dfef6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:15.483217 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-dfb0a234-1322-404e-886c-15ed1a0dfef6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: e7dba9b8-ff69-4964-bfdb-9d3bf4d57886] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:15.490421 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-dfb0a234-1322-404e-886c-15ed1a0dfef6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:15.490865 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-dfb0a234-1322-404e-886c-15ed1a0dfef6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:15.491653 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-dfb0a234-1322-404e-886c-15ed1a0dfef6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:15.493001 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-dfb0a234-1322-404e-886c-15ed1a0dfef6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:15.649616 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-dfb0a234-1322-404e-886c-15ed1a0dfef6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:15.657228 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-dfb0a234-1322-404e-886c-15ed1a0dfef6 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886" status: 200 len: 1314 microversion: 2.1 time: 0.178988 Dec 20 03:36:15.657897 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 506/1000] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:15 2021] GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:15.708229 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-287498d0-fb76-4730-94b8-1b095a46df82 req-14dfa8d7-744e-43e4-9efc-90e6aea22a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc84db6-8d02-4fd4-b38c-c0a90f104993", "name": "network-vif-plugged", "status": "completed", "tag": "dcafb0f8-ea15-4cf6-ace1-0817393056e3"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:36:15.709815 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:36:15.709815 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:36:15.716701 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-287498d0-fb76-4730-94b8-1b095a46df82 req-14dfa8d7-744e-43e4-9efc-90e6aea22a04 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:15.717174 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-287498d0-fb76-4730-94b8-1b095a46df82 req-14dfa8d7-744e-43e4-9efc-90e6aea22a04 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:15.728600 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-287498d0-fb76-4730-94b8-1b095a46df82 req-14dfa8d7-744e-43e4-9efc-90e6aea22a04 service nova] Creating event network-vif-plugged:dcafb0f8-ea15-4cf6-ace1-0817393056e3 for instance 3cc84db6-8d02-4fd4-b38c-c0a90f104993 on hv-cinder-81803 Dec 20 03:36:15.733606 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-287498d0-fb76-4730-94b8-1b095a46df82 req-14dfa8d7-744e-43e4-9efc-90e6aea22a04 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028906 Dec 20 03:36:15.734658 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 495/1001] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:36:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:36:16.057109 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-6034e740-d377-4deb-a9da-b52dce38f539 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:16.057686 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6034e740-d377-4deb-a9da-b52dce38f539 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:16.065992 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6034e740-d377-4deb-a9da-b52dce38f539 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:16.067135 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6034e740-d377-4deb-a9da-b52dce38f539 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:16.067290 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6034e740-d377-4deb-a9da-b52dce38f539 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:16.067661 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6034e740-d377-4deb-a9da-b52dce38f539 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:16.222295 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-6034e740-d377-4deb-a9da-b52dce38f539 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:16.229936 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-6034e740-d377-4deb-a9da-b52dce38f539 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1573 microversion: 2.1 time: 0.176591 Dec 20 03:36:16.230521 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 507/1002] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:16 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1573 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:16.675383 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-87b48509-0955-41b0-98c6-8112b2753286 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:16.676152 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-87b48509-0955-41b0-98c6-8112b2753286 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: e7dba9b8-ff69-4964-bfdb-9d3bf4d57886] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:16.682432 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-87b48509-0955-41b0-98c6-8112b2753286 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:16.682805 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-87b48509-0955-41b0-98c6-8112b2753286 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:16.683588 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-87b48509-0955-41b0-98c6-8112b2753286 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:16.684021 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-87b48509-0955-41b0-98c6-8112b2753286 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:16.837780 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-87b48509-0955-41b0-98c6-8112b2753286 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:16.846293 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-87b48509-0955-41b0-98c6-8112b2753286 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886" status: 200 len: 1498 microversion: 2.1 time: 0.175788 Dec 20 03:36:16.846858 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 496/1003] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:16 2021] GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 => generated 1498 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:17.248225 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-38302a7e-a733-4045-8e97-7869b415cf7a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:17.248854 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-38302a7e-a733-4045-8e97-7869b415cf7a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:17.256405 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-38302a7e-a733-4045-8e97-7869b415cf7a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:17.256863 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-38302a7e-a733-4045-8e97-7869b415cf7a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:17.257716 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-38302a7e-a733-4045-8e97-7869b415cf7a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:17.258155 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-38302a7e-a733-4045-8e97-7869b415cf7a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:17.408438 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-38302a7e-a733-4045-8e97-7869b415cf7a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:17.415954 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-38302a7e-a733-4045-8e97-7869b415cf7a tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1573 microversion: 2.1 time: 0.171675 Dec 20 03:36:17.416844 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 508/1004] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:17 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1573 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:18.018470 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-abdfd8fe-c11c-4174-be85-608deca60e60 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:18.019080 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-abdfd8fe-c11c-4174-be85-608deca60e60 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: e7dba9b8-ff69-4964-bfdb-9d3bf4d57886] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:18.025389 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-abdfd8fe-c11c-4174-be85-608deca60e60 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:18.025840 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-abdfd8fe-c11c-4174-be85-608deca60e60 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:18.026631 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-abdfd8fe-c11c-4174-be85-608deca60e60 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:18.027070 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-abdfd8fe-c11c-4174-be85-608deca60e60 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:18.054482 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-abdfd8fe-c11c-4174-be85-608deca60e60 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: e7dba9b8-ff69-4964-bfdb-9d3bf4d57886] Going to try to terminate instance {{(pid=117012) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:36:18.273969 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-abdfd8fe-c11c-4174-be85-608deca60e60 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "DELETE /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886" status: 204 len: 0 microversion: 2.1 time: 0.258893 Dec 20 03:36:18.274483 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 497/1005] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:36:18 2021] DELETE /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:36:18.282915 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-634ebe66-eed7-49fa-af39-5468e25e8dda tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:18.285502 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-634ebe66-eed7-49fa-af39-5468e25e8dda tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: e7dba9b8-ff69-4964-bfdb-9d3bf4d57886] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:18.290152 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-634ebe66-eed7-49fa-af39-5468e25e8dda tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:18.290605 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-634ebe66-eed7-49fa-af39-5468e25e8dda tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:18.291425 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-634ebe66-eed7-49fa-af39-5468e25e8dda tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:18.291859 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-634ebe66-eed7-49fa-af39-5468e25e8dda tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:18.427735 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-634ebe66-eed7-49fa-af39-5468e25e8dda tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:18.434432 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c872dbd5-4cba-4215-8237-2b873b38ab4c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:18.435194 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c872dbd5-4cba-4215-8237-2b873b38ab4c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:18.435708 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-634ebe66-eed7-49fa-af39-5468e25e8dda tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886" status: 200 len: 1504 microversion: 2.1 time: 0.156575 Dec 20 03:36:18.436287 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 509/1006] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:18 2021] GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:18.445680 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c872dbd5-4cba-4215-8237-2b873b38ab4c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:18.446205 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c872dbd5-4cba-4215-8237-2b873b38ab4c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:18.446919 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c872dbd5-4cba-4215-8237-2b873b38ab4c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:18.447378 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c872dbd5-4cba-4215-8237-2b873b38ab4c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:18.585343 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c872dbd5-4cba-4215-8237-2b873b38ab4c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:18.592844 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c872dbd5-4cba-4215-8237-2b873b38ab4c tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1560 microversion: 2.1 time: 0.162347 Dec 20 03:36:18.593959 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 498/1007] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:18 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:19.451911 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-da7a884c-5bae-47b5-a0a5-02abc14ae331 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:19.453298 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-da7a884c-5bae-47b5-a0a5-02abc14ae331 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: e7dba9b8-ff69-4964-bfdb-9d3bf4d57886] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:19.459725 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-da7a884c-5bae-47b5-a0a5-02abc14ae331 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:19.460166 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-da7a884c-5bae-47b5-a0a5-02abc14ae331 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:19.460947 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-da7a884c-5bae-47b5-a0a5-02abc14ae331 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:19.461425 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-da7a884c-5bae-47b5-a0a5-02abc14ae331 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:19.591926 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-da7a884c-5bae-47b5-a0a5-02abc14ae331 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:19.599370 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-da7a884c-5bae-47b5-a0a5-02abc14ae331 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886" status: 200 len: 1504 microversion: 2.1 time: 0.151117 Dec 20 03:36:19.599936 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 510/1008] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:19 2021] GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:20.553294 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-af81f619-f030-4f5d-aa85-a1bb09a58752 req-1178f728-2c81-42c3-8be1-fe3298d2b59f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7dba9b8-ff69-4964-bfdb-9d3bf4d57886", "name": "network-vif-deleted", "tag": "bc075a73-a26f-477b-ba75-113f1643c36d"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:36:20.554805 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:36:20.554805 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:36:20.562251 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-af81f619-f030-4f5d-aa85-a1bb09a58752 req-1178f728-2c81-42c3-8be1-fe3298d2b59f service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:20.566737 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-af81f619-f030-4f5d-aa85-a1bb09a58752 req-1178f728-2c81-42c3-8be1-fe3298d2b59f service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:20.573424 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-af81f619-f030-4f5d-aa85-a1bb09a58752 req-1178f728-2c81-42c3-8be1-fe3298d2b59f service nova] Creating event network-vif-deleted:bc075a73-a26f-477b-ba75-113f1643c36d for instance e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 on hv-cinder-81803 Dec 20 03:36:20.578762 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-af81f619-f030-4f5d-aa85-a1bb09a58752 req-1178f728-2c81-42c3-8be1-fe3298d2b59f service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029072 Dec 20 03:36:20.579356 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 499/1009] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:36:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:36:20.615822 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-7af0daa5-0656-4a51-92c1-63283b39e7eb tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:20.616426 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-7af0daa5-0656-4a51-92c1-63283b39e7eb tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: e7dba9b8-ff69-4964-bfdb-9d3bf4d57886] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:20.622919 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7af0daa5-0656-4a51-92c1-63283b39e7eb tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:20.624899 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7af0daa5-0656-4a51-92c1-63283b39e7eb tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:20.624899 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7af0daa5-0656-4a51-92c1-63283b39e7eb tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:20.625413 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7af0daa5-0656-4a51-92c1-63283b39e7eb tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:20.692062 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-7af0daa5-0656-4a51-92c1-63283b39e7eb tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:20.699689 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-7af0daa5-0656-4a51-92c1-63283b39e7eb tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886" status: 200 len: 1462 microversion: 2.1 time: 0.087615 Dec 20 03:36:20.700250 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 511/1010] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:20 2021] GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 => generated 1462 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:21.719951 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-53e73bf2-a6b8-46eb-adcf-0c7445f60cde tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:21.720703 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-53e73bf2-a6b8-46eb-adcf-0c7445f60cde tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: e7dba9b8-ff69-4964-bfdb-9d3bf4d57886] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:21.727191 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-53e73bf2-a6b8-46eb-adcf-0c7445f60cde tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:21.727673 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-53e73bf2-a6b8-46eb-adcf-0c7445f60cde tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:21.728455 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-53e73bf2-a6b8-46eb-adcf-0c7445f60cde tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:21.728896 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-53e73bf2-a6b8-46eb-adcf-0c7445f60cde tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:21.742335 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-53e73bf2-a6b8-46eb-adcf-0c7445f60cde tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] HTTP exception thrown: Instance e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 could not be found. Dec 20 03:36:21.742912 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-53e73bf2-a6b8-46eb-adcf-0c7445f60cde tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Returning 404 to user: Instance e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:36:21.743727 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-53e73bf2-a6b8-46eb-adcf-0c7445f60cde tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886" status: 404 len: 111 microversion: 2.1 time: 0.029566 Dec 20 03:36:21.744266 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 500/1011] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:21 2021] GET /compute/v2.1/servers/e7dba9b8-ff69-4964-bfdb-9d3bf4d57886 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:36:21.793063 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-08e2cc21-148c-4b17-b1ce-a2c2af4f0453 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2119624585", "imageRef": "9c4ec443-915b-4997-82d3-08cc97ba635b", "flavorRef": "452", "networks": [{"uuid": "756124ed-9b1d-42f9-9b67-504c14da1547"}]}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:36:21.847686 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.network.neutron [None req-08e2cc21-148c-4b17-b1ce-a2c2af4f0453 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] validate_networks() for [('756124ed-9b1d-42f9-9b67-504c14da1547', None, None, None, None, None)] {{(pid=117011) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:36:22.474537 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-08e2cc21-148c-4b17-b1ce-a2c2af4f0453 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Flavor limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:36:22.474952 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-08e2cc21-148c-4b17-b1ce-a2c2af4f0453 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Image limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:36:22.475419 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-08e2cc21-148c-4b17-b1ce-a2c2af4f0453 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Flavor pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:36:22.475822 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-08e2cc21-148c-4b17-b1ce-a2c2af4f0453 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Image pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:36:22.476229 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-08e2cc21-148c-4b17-b1ce-a2c2af4f0453 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:36:22.486457 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-08e2cc21-148c-4b17-b1ce-a2c2af4f0453 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:22.486899 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-08e2cc21-148c-4b17-b1ce-a2c2af4f0453 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:22.487936 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-08e2cc21-148c-4b17-b1ce-a2c2af4f0453 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:22.488368 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-08e2cc21-148c-4b17-b1ce-a2c2af4f0453 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:22.504969 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-08e2cc21-148c-4b17-b1ce-a2c2af4f0453 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Getting quotas for project 4c82837589244f669a18d91e30105e14. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:36:22.509107 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-08e2cc21-148c-4b17-b1ce-a2c2af4f0453 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Getting quotas for user 5cfe2917349e43448f38bf960db4bc42 and project 4c82837589244f669a18d91e30105e14. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:36:22.520387 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-08e2cc21-148c-4b17-b1ce-a2c2af4f0453 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Going to run 1 instances... {{(pid=117011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:36:22.522735 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-08e2cc21-148c-4b17-b1ce-a2c2af4f0453 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: 5717455e-f92f-432a-b683-bc896e68a78c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c4ec443-915b-4997-82d3-08cc97ba635b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:36:22.709365 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-08e2cc21-148c-4b17-b1ce-a2c2af4f0453 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.919816 Dec 20 03:36:22.709941 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 512/1012] 10.222.0.53 () {60 vars in 1146 bytes} [Mon Dec 20 03:36:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 03:36:22.720921 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1cd59861-6368-427e-92d0-57470faa85f9 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:22.721565 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1cd59861-6368-427e-92d0-57470faa85f9 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: 5717455e-f92f-432a-b683-bc896e68a78c] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:22.777438 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1cd59861-6368-427e-92d0-57470faa85f9 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:22.787907 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1cd59861-6368-427e-92d0-57470faa85f9 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c" status: 200 len: 1214 microversion: 2.1 time: 0.071444 Dec 20 03:36:22.788938 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 501/1013] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:22 2021] GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:23.804723 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1859aefe-a13f-47dd-8ed1-820cdaa061af tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:23.805349 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1859aefe-a13f-47dd-8ed1-820cdaa061af tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: 5717455e-f92f-432a-b683-bc896e68a78c] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:23.811915 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1859aefe-a13f-47dd-8ed1-820cdaa061af tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:23.812368 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1859aefe-a13f-47dd-8ed1-820cdaa061af tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:23.813433 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1859aefe-a13f-47dd-8ed1-820cdaa061af tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:23.813812 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1859aefe-a13f-47dd-8ed1-820cdaa061af tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:23.880261 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-1859aefe-a13f-47dd-8ed1-820cdaa061af tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:23.887782 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1859aefe-a13f-47dd-8ed1-820cdaa061af tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c" status: 200 len: 1218 microversion: 2.1 time: 0.086752 Dec 20 03:36:23.888344 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 513/1014] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:23 2021] GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:24.904713 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d47993b8-d00d-4183-9b5c-c29bebad47c9 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:24.905434 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d47993b8-d00d-4183-9b5c-c29bebad47c9 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: 5717455e-f92f-432a-b683-bc896e68a78c] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:24.912868 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d47993b8-d00d-4183-9b5c-c29bebad47c9 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:24.913359 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d47993b8-d00d-4183-9b5c-c29bebad47c9 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:24.914170 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d47993b8-d00d-4183-9b5c-c29bebad47c9 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:24.914613 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d47993b8-d00d-4183-9b5c-c29bebad47c9 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:24.994172 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d47993b8-d00d-4183-9b5c-c29bebad47c9 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:25.004846 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d47993b8-d00d-4183-9b5c-c29bebad47c9 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c" status: 200 len: 1274 microversion: 2.1 time: 0.103502 Dec 20 03:36:25.005926 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 502/1015] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:24 2021] GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c => generated 1274 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:36:26.027375 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-5112dda1-4af7-4406-8908-31e28af3c605 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:26.027992 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-5112dda1-4af7-4406-8908-31e28af3c605 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: 5717455e-f92f-432a-b683-bc896e68a78c] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:26.034891 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5112dda1-4af7-4406-8908-31e28af3c605 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:26.035281 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5112dda1-4af7-4406-8908-31e28af3c605 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:26.040061 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5112dda1-4af7-4406-8908-31e28af3c605 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:26.041223 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5112dda1-4af7-4406-8908-31e28af3c605 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:26.176838 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-5112dda1-4af7-4406-8908-31e28af3c605 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:26.181687 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-5112dda1-4af7-4406-8908-31e28af3c605 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c" status: 200 len: 1314 microversion: 2.1 time: 0.158161 Dec 20 03:36:26.182250 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 514/1016] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:26 2021] GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:26.685957 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-19a64990-a057-44f1-bc20-083bf8834d9a req-04939461-c850-4dc2-87e7-118d97bd2b0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5717455e-f92f-432a-b683-bc896e68a78c", "tag": "e168bfde-ec9d-4c77-a7cf-d39e6607f749"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:36:26.687593 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:36:26.687593 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:36:26.696562 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-19a64990-a057-44f1-bc20-083bf8834d9a req-04939461-c850-4dc2-87e7-118d97bd2b0a service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:26.697006 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-19a64990-a057-44f1-bc20-083bf8834d9a req-04939461-c850-4dc2-87e7-118d97bd2b0a service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:26.709027 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-19a64990-a057-44f1-bc20-083bf8834d9a req-04939461-c850-4dc2-87e7-118d97bd2b0a service nova] Creating event network-changed:e168bfde-ec9d-4c77-a7cf-d39e6607f749 for instance 5717455e-f92f-432a-b683-bc896e68a78c on hv-cinder-81803 Dec 20 03:36:26.713702 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-19a64990-a057-44f1-bc20-083bf8834d9a req-04939461-c850-4dc2-87e7-118d97bd2b0a service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031503 Dec 20 03:36:26.714301 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 503/1017] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:36:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:36:27.198484 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-5c4fc80f-706b-4a74-92ec-167dc36fe7b9 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:27.199088 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-5c4fc80f-706b-4a74-92ec-167dc36fe7b9 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: 5717455e-f92f-432a-b683-bc896e68a78c] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:27.205332 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5c4fc80f-706b-4a74-92ec-167dc36fe7b9 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:27.205792 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5c4fc80f-706b-4a74-92ec-167dc36fe7b9 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:27.206583 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5c4fc80f-706b-4a74-92ec-167dc36fe7b9 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:27.207020 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5c4fc80f-706b-4a74-92ec-167dc36fe7b9 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:27.341414 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-5c4fc80f-706b-4a74-92ec-167dc36fe7b9 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:27.349808 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-5c4fc80f-706b-4a74-92ec-167dc36fe7b9 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c" status: 200 len: 1314 microversion: 2.1 time: 0.154861 Dec 20 03:36:27.350624 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 515/1018] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:27 2021] GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:28.366941 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1dc0bcfb-946e-4381-9d18-882fddf40981 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:28.367640 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1dc0bcfb-946e-4381-9d18-882fddf40981 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: 5717455e-f92f-432a-b683-bc896e68a78c] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:28.373891 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1dc0bcfb-946e-4381-9d18-882fddf40981 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:28.374595 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1dc0bcfb-946e-4381-9d18-882fddf40981 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:28.375449 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1dc0bcfb-946e-4381-9d18-882fddf40981 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:28.375885 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1dc0bcfb-946e-4381-9d18-882fddf40981 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:28.508325 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1dc0bcfb-946e-4381-9d18-882fddf40981 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:28.515734 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1dc0bcfb-946e-4381-9d18-882fddf40981 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c" status: 200 len: 1314 microversion: 2.1 time: 0.153765 Dec 20 03:36:28.516311 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 504/1019] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:28 2021] GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:29.532702 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-adda018b-727a-4337-9229-84264ded1b1e tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:29.533889 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-adda018b-727a-4337-9229-84264ded1b1e tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: 5717455e-f92f-432a-b683-bc896e68a78c] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:29.540227 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-adda018b-727a-4337-9229-84264ded1b1e tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:29.551541 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-adda018b-727a-4337-9229-84264ded1b1e tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:29.551541 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-adda018b-727a-4337-9229-84264ded1b1e tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:29.551541 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-adda018b-727a-4337-9229-84264ded1b1e tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:29.688305 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-adda018b-727a-4337-9229-84264ded1b1e tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:29.695477 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-adda018b-727a-4337-9229-84264ded1b1e tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c" status: 200 len: 1314 microversion: 2.1 time: 0.166345 Dec 20 03:36:29.696047 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 516/1020] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:29 2021] GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:30.712051 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f9f09373-1872-4032-9456-18a6a51ec561 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:30.712615 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f9f09373-1872-4032-9456-18a6a51ec561 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: 5717455e-f92f-432a-b683-bc896e68a78c] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:30.718853 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f9f09373-1872-4032-9456-18a6a51ec561 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:30.719297 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f9f09373-1872-4032-9456-18a6a51ec561 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:30.720085 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f9f09373-1872-4032-9456-18a6a51ec561 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:30.720519 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f9f09373-1872-4032-9456-18a6a51ec561 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:30.868812 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-f9f09373-1872-4032-9456-18a6a51ec561 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:30.878527 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f9f09373-1872-4032-9456-18a6a51ec561 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c" status: 200 len: 1314 microversion: 2.1 time: 0.170154 Dec 20 03:36:30.879109 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 505/1021] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:30 2021] GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:31.430758 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-37da3c55-3488-4c42-a2da-b78653af3519 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:31.431444 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-37da3c55-3488-4c42-a2da-b78653af3519 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:31.437994 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-37da3c55-3488-4c42-a2da-b78653af3519 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:31.438450 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-37da3c55-3488-4c42-a2da-b78653af3519 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:31.439247 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-37da3c55-3488-4c42-a2da-b78653af3519 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:31.440514 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-37da3c55-3488-4c42-a2da-b78653af3519 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:31.470877 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-37da3c55-3488-4c42-a2da-b78653af3519 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/os-volume_attachments/065d642a-89f4-4804-aab4-ecc5bfdbd403" status: 200 len: 194 microversion: 2.20 time: 0.043825 Dec 20 03:36:31.471756 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 517/1022] 10.222.0.53 () {60 vars in 1453 bytes} [Mon Dec 20 03:36:31 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/os-volume_attachments/065d642a-89f4-4804-aab4-ecc5bfdbd403 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:36:31.537668 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-eeddac7a-5f94-4c02-bead-33a37d6fb286 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:31.545670 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-eeddac7a-5f94-4c02-bead-33a37d6fb286 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:31.546315 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-eeddac7a-5f94-4c02-bead-33a37d6fb286 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:31.546863 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-eeddac7a-5f94-4c02-bead-33a37d6fb286 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:31.547757 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-eeddac7a-5f94-4c02-bead-33a37d6fb286 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:31.548355 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-eeddac7a-5f94-4c02-bead-33a37d6fb286 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:31.630997 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.objects.instance [None req-eeddac7a-5f94-4c02-bead-33a37d6fb286 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lazy-loading 'services' on Instance uuid 4a1645c1-a90b-406b-ba58-0620598ecf89 {{(pid=117012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:36:31.759927 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-74f3dbd5-cd2d-4138-bfc2-add57b947030 req-07ac97a7-c48e-4065-baf5-d1a45bd2d1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5717455e-f92f-432a-b683-bc896e68a78c", "name": "network-vif-plugged", "status": "completed", "tag": "e168bfde-ec9d-4c77-a7cf-d39e6607f749"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:36:31.761598 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:36:31.761598 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:36:31.769624 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-74f3dbd5-cd2d-4138-bfc2-add57b947030 req-07ac97a7-c48e-4065-baf5-d1a45bd2d1d4 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:31.771615 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-74f3dbd5-cd2d-4138-bfc2-add57b947030 req-07ac97a7-c48e-4065-baf5-d1a45bd2d1d4 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:31.781952 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-74f3dbd5-cd2d-4138-bfc2-add57b947030 req-07ac97a7-c48e-4065-baf5-d1a45bd2d1d4 service nova] Creating event network-vif-plugged:e168bfde-ec9d-4c77-a7cf-d39e6607f749 for instance 5717455e-f92f-432a-b683-bc896e68a78c on hv-cinder-81803 Dec 20 03:36:31.787718 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-74f3dbd5-cd2d-4138-bfc2-add57b947030 req-07ac97a7-c48e-4065-baf5-d1a45bd2d1d4 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031365 Dec 20 03:36:31.788323 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 518/1023] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:36:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:36:31.896300 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-89d0b088-bdf8-4ebf-887a-2f509dcfa56b tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:31.897084 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-89d0b088-bdf8-4ebf-887a-2f509dcfa56b tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: 5717455e-f92f-432a-b683-bc896e68a78c] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:31.903376 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-89d0b088-bdf8-4ebf-887a-2f509dcfa56b tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:31.903913 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-89d0b088-bdf8-4ebf-887a-2f509dcfa56b tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:31.904772 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-89d0b088-bdf8-4ebf-887a-2f509dcfa56b tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:31.905479 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-89d0b088-bdf8-4ebf-887a-2f509dcfa56b tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:31.910510 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-eeddac7a-5f94-4c02-bead-33a37d6fb286 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "DELETE /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/os-volume_attachments/065d642a-89f4-4804-aab4-ecc5bfdbd403" status: 202 len: 0 microversion: 2.20 time: 0.376192 Dec 20 03:36:31.914356 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 506/1024] 10.222.0.53 () {60 vars in 1456 bytes} [Mon Dec 20 03:36:31 2021] DELETE /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/os-volume_attachments/065d642a-89f4-4804-aab4-ecc5bfdbd403 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:36:31.922039 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-5e0f4057-c260-474d-8e7e-59fda02d70b0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:31.923295 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-5e0f4057-c260-474d-8e7e-59fda02d70b0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:31.930849 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5e0f4057-c260-474d-8e7e-59fda02d70b0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:31.931406 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5e0f4057-c260-474d-8e7e-59fda02d70b0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:31.933126 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5e0f4057-c260-474d-8e7e-59fda02d70b0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:31.940768 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5e0f4057-c260-474d-8e7e-59fda02d70b0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:31.973778 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-5e0f4057-c260-474d-8e7e-59fda02d70b0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056161 Dec 20 03:36:31.977442 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 507/1025] 10.222.0.53 () {60 vars in 1342 bytes} [Mon Dec 20 03:36:31 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:36:32.060807 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-89d0b088-bdf8-4ebf-887a-2f509dcfa56b tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:32.063854 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-89d0b088-bdf8-4ebf-887a-2f509dcfa56b tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c" status: 200 len: 1314 microversion: 2.1 time: 0.172560 Dec 20 03:36:32.064410 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 519/1026] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:31 2021] GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:36:32.991986 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-4f3f4782-9356-425e-aaac-59d0c478c421 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:32.993627 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-4f3f4782-9356-425e-aaac-59d0c478c421 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:33.005649 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4f3f4782-9356-425e-aaac-59d0c478c421 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:33.006292 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4f3f4782-9356-425e-aaac-59d0c478c421 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:33.007398 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4f3f4782-9356-425e-aaac-59d0c478c421 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:33.008337 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4f3f4782-9356-425e-aaac-59d0c478c421 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:33.082040 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d6d0834d-c4b5-4fd3-a5af-f96042e76e0d tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:33.082769 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d6d0834d-c4b5-4fd3-a5af-f96042e76e0d tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: 5717455e-f92f-432a-b683-bc896e68a78c] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:33.093070 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d6d0834d-c4b5-4fd3-a5af-f96042e76e0d tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:33.093070 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d6d0834d-c4b5-4fd3-a5af-f96042e76e0d tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:33.093070 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d6d0834d-c4b5-4fd3-a5af-f96042e76e0d tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:33.093070 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d6d0834d-c4b5-4fd3-a5af-f96042e76e0d tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:33.198887 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-4f3f4782-9356-425e-aaac-59d0c478c421 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.214548 Dec 20 03:36:33.199475 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 508/1027] 10.222.0.53 () {60 vars in 1342 bytes} [Mon Dec 20 03:36:32 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/os-volume_attachments => generated 197 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:36:33.234637 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d6d0834d-c4b5-4fd3-a5af-f96042e76e0d tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:33.242647 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d6d0834d-c4b5-4fd3-a5af-f96042e76e0d tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c" status: 200 len: 1314 microversion: 2.1 time: 0.165390 Dec 20 03:36:33.243196 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 520/1028] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:33 2021] GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:36:34.215080 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-2e91801c-878b-4d5f-9d17-5c66640e51f3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:34.215930 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-2e91801c-878b-4d5f-9d17-5c66640e51f3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:34.222502 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2e91801c-878b-4d5f-9d17-5c66640e51f3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:34.222955 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2e91801c-878b-4d5f-9d17-5c66640e51f3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:34.223752 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2e91801c-878b-4d5f-9d17-5c66640e51f3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:34.224194 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2e91801c-878b-4d5f-9d17-5c66640e51f3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:34.254777 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-2e91801c-878b-4d5f-9d17-5c66640e51f3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043489 Dec 20 03:36:34.255340 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 509/1029] 10.222.0.53 () {60 vars in 1342 bytes} [Mon Dec 20 03:36:34 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:34.259847 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ea714111-50f4-4da7-8e7f-e3494f60975d tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:34.260644 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ea714111-50f4-4da7-8e7f-e3494f60975d tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: 5717455e-f92f-432a-b683-bc896e68a78c] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:34.266646 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ea714111-50f4-4da7-8e7f-e3494f60975d tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:34.267088 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ea714111-50f4-4da7-8e7f-e3494f60975d tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:34.268461 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ea714111-50f4-4da7-8e7f-e3494f60975d tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:34.268897 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ea714111-50f4-4da7-8e7f-e3494f60975d tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:34.311674 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ae53a97a-9dcd-4e38-bf57-99e4e764ae91 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:34.312183 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ae53a97a-9dcd-4e38-bf57-99e4e764ae91 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:34.318805 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ae53a97a-9dcd-4e38-bf57-99e4e764ae91 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:34.319296 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ae53a97a-9dcd-4e38-bf57-99e4e764ae91 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:34.320093 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ae53a97a-9dcd-4e38-bf57-99e4e764ae91 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:34.320537 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ae53a97a-9dcd-4e38-bf57-99e4e764ae91 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:34.346782 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ae53a97a-9dcd-4e38-bf57-99e4e764ae91 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Going to try to terminate instance {{(pid=117012) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:36:34.410942 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ea714111-50f4-4da7-8e7f-e3494f60975d tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:34.419135 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ea714111-50f4-4da7-8e7f-e3494f60975d tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c" status: 200 len: 1499 microversion: 2.1 time: 0.163076 Dec 20 03:36:34.419702 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 521/1030] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:34 2021] GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c => generated 1499 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:36:34.650840 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ae53a97a-9dcd-4e38-bf57-99e4e764ae91 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "DELETE /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 204 len: 0 microversion: 2.20 time: 0.342541 Dec 20 03:36:34.651448 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 510/1031] 10.222.0.53 () {60 vars in 1279 bytes} [Mon Dec 20 03:36:34 2021] DELETE /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 20 03:36:34.659549 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d454705c-48b0-436b-a7d9-efc949c9673d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:34.660190 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d454705c-48b0-436b-a7d9-efc949c9673d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:34.666245 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d454705c-48b0-436b-a7d9-efc949c9673d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:34.666697 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d454705c-48b0-436b-a7d9-efc949c9673d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:34.667489 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d454705c-48b0-436b-a7d9-efc949c9673d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:34.667935 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d454705c-48b0-436b-a7d9-efc949c9673d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:34.807688 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d454705c-48b0-436b-a7d9-efc949c9673d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:34.815850 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d454705c-48b0-436b-a7d9-efc949c9673d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:34.817385 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d454705c-48b0-436b-a7d9-efc949c9673d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:34.818555 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d454705c-48b0-436b-a7d9-efc949c9673d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1723 microversion: 2.20 time: 0.162832 Dec 20 03:36:34.819106 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 522/1032] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:36:34 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:36:35.316327 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f0c0d29b-9b23-4cb3-b9ab-233b26d3779e tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:35.319251 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f0c0d29b-9b23-4cb3-b9ab-233b26d3779e tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: 5717455e-f92f-432a-b683-bc896e68a78c] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:35.323573 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f0c0d29b-9b23-4cb3-b9ab-233b26d3779e tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:35.324025 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f0c0d29b-9b23-4cb3-b9ab-233b26d3779e tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:35.324811 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f0c0d29b-9b23-4cb3-b9ab-233b26d3779e tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:35.325288 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f0c0d29b-9b23-4cb3-b9ab-233b26d3779e tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:35.352880 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f0c0d29b-9b23-4cb3-b9ab-233b26d3779e tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: 5717455e-f92f-432a-b683-bc896e68a78c] Going to try to terminate instance {{(pid=117012) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:36:35.583232 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f0c0d29b-9b23-4cb3-b9ab-233b26d3779e tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "DELETE /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c" status: 204 len: 0 microversion: 2.1 time: 0.270667 Dec 20 03:36:35.590950 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 511/1033] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:36:35 2021] DELETE /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:36:35.592814 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ca08b412-7a17-46b8-9a2f-7b5946c15811 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:35.593459 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ca08b412-7a17-46b8-9a2f-7b5946c15811 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: 5717455e-f92f-432a-b683-bc896e68a78c] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:35.600328 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ca08b412-7a17-46b8-9a2f-7b5946c15811 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:35.600789 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ca08b412-7a17-46b8-9a2f-7b5946c15811 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:35.601693 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ca08b412-7a17-46b8-9a2f-7b5946c15811 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:35.602160 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ca08b412-7a17-46b8-9a2f-7b5946c15811 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:35.741580 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ca08b412-7a17-46b8-9a2f-7b5946c15811 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:35.749754 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ca08b412-7a17-46b8-9a2f-7b5946c15811 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c" status: 200 len: 1505 microversion: 2.1 time: 0.160443 Dec 20 03:36:35.750352 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 523/1034] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:35 2021] GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:35.838278 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-531dd763-34f1-4c18-a1d4-57bca73423be tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:35.838885 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-531dd763-34f1-4c18-a1d4-57bca73423be tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:35.844962 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-531dd763-34f1-4c18-a1d4-57bca73423be tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:35.845438 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-531dd763-34f1-4c18-a1d4-57bca73423be tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:35.846745 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-531dd763-34f1-4c18-a1d4-57bca73423be tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:35.847194 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-531dd763-34f1-4c18-a1d4-57bca73423be tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:35.988217 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-531dd763-34f1-4c18-a1d4-57bca73423be tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:35.996364 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-531dd763-34f1-4c18-a1d4-57bca73423be tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:35.997892 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-531dd763-34f1-4c18-a1d4-57bca73423be tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:35.999045 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-531dd763-34f1-4c18-a1d4-57bca73423be tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1723 microversion: 2.20 time: 0.165074 Dec 20 03:36:35.999856 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 512/1035] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:36:35 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:36:36.767537 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-8a34a6a2-be11-4da7-b040-d26af813c348 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:36.768169 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-8a34a6a2-be11-4da7-b040-d26af813c348 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: 5717455e-f92f-432a-b683-bc896e68a78c] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:36.774668 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8a34a6a2-be11-4da7-b040-d26af813c348 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:36.775319 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8a34a6a2-be11-4da7-b040-d26af813c348 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:36.776170 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8a34a6a2-be11-4da7-b040-d26af813c348 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:36.776601 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8a34a6a2-be11-4da7-b040-d26af813c348 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:36.923773 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-8a34a6a2-be11-4da7-b040-d26af813c348 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:36.932189 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-8a34a6a2-be11-4da7-b040-d26af813c348 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c" status: 200 len: 1505 microversion: 2.1 time: 0.168188 Dec 20 03:36:36.932768 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 524/1036] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:36 2021] GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:37.017169 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-32ffbad9-84b9-4912-98ac-b59da046755a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:37.017696 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-32ffbad9-84b9-4912-98ac-b59da046755a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:37.024337 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-32ffbad9-84b9-4912-98ac-b59da046755a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:37.024785 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-32ffbad9-84b9-4912-98ac-b59da046755a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:37.025651 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-32ffbad9-84b9-4912-98ac-b59da046755a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:37.026084 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-32ffbad9-84b9-4912-98ac-b59da046755a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:37.290023 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-32ffbad9-84b9-4912-98ac-b59da046755a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:37.298739 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-32ffbad9-84b9-4912-98ac-b59da046755a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:37.300335 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-32ffbad9-84b9-4912-98ac-b59da046755a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:37.301565 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-32ffbad9-84b9-4912-98ac-b59da046755a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1723 microversion: 2.20 time: 0.288162 Dec 20 03:36:37.302141 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 513/1037] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:36:37 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:36:37.949896 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ef8cba66-bfca-4e6b-a2a2-784f9af59593 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:37.950968 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ef8cba66-bfca-4e6b-a2a2-784f9af59593 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: 5717455e-f92f-432a-b683-bc896e68a78c] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:37.958316 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ef8cba66-bfca-4e6b-a2a2-784f9af59593 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:37.959067 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ef8cba66-bfca-4e6b-a2a2-784f9af59593 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:37.959978 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ef8cba66-bfca-4e6b-a2a2-784f9af59593 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:37.960367 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ef8cba66-bfca-4e6b-a2a2-784f9af59593 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:38.116392 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ef8cba66-bfca-4e6b-a2a2-784f9af59593 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:38.137465 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ef8cba66-bfca-4e6b-a2a2-784f9af59593 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c" status: 200 len: 1505 microversion: 2.1 time: 0.191131 Dec 20 03:36:38.149331 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 525/1038] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:37 2021] GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:38.183753 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-835aad40-b491-41e3-a594-47a4f8fa1de7 req-9837cf07-e4f7-4fef-ab0c-13806acc8f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1645c1-a90b-406b-ba58-0620598ecf89", "name": "network-vif-deleted", "tag": "31810791-54e6-413e-889b-510ef52f5b14"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:36:38.188361 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:36:38.188361 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:36:38.200219 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-835aad40-b491-41e3-a594-47a4f8fa1de7 req-9837cf07-e4f7-4fef-ab0c-13806acc8f8e service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:38.201335 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-835aad40-b491-41e3-a594-47a4f8fa1de7 req-9837cf07-e4f7-4fef-ab0c-13806acc8f8e service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:38.222033 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-835aad40-b491-41e3-a594-47a4f8fa1de7 req-9837cf07-e4f7-4fef-ab0c-13806acc8f8e service nova] Creating event network-vif-deleted:31810791-54e6-413e-889b-510ef52f5b14 for instance 4a1645c1-a90b-406b-ba58-0620598ecf89 on hv-cinder-81803 Dec 20 03:36:38.229002 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-835aad40-b491-41e3-a594-47a4f8fa1de7 req-9837cf07-e4f7-4fef-ab0c-13806acc8f8e service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052148 Dec 20 03:36:38.230173 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 514/1039] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:36:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:36:38.320589 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ec0f9e80-0a33-4dcd-95df-cd07dc28d66e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:38.321157 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ec0f9e80-0a33-4dcd-95df-cd07dc28d66e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:38.327566 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ec0f9e80-0a33-4dcd-95df-cd07dc28d66e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:38.330135 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ec0f9e80-0a33-4dcd-95df-cd07dc28d66e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:38.330135 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ec0f9e80-0a33-4dcd-95df-cd07dc28d66e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:38.330135 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ec0f9e80-0a33-4dcd-95df-cd07dc28d66e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:38.426286 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ec0f9e80-0a33-4dcd-95df-cd07dc28d66e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:38.435769 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ec0f9e80-0a33-4dcd-95df-cd07dc28d66e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:38.437409 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ec0f9e80-0a33-4dcd-95df-cd07dc28d66e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:38.441716 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ec0f9e80-0a33-4dcd-95df-cd07dc28d66e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 200 len: 1656 microversion: 2.20 time: 0.122344 Dec 20 03:36:38.441716 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 526/1040] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:36:38 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 1656 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:36:39.156107 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-950bb766-bfcb-4cd0-b5bd-43936a7fcefd tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:39.156979 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-950bb766-bfcb-4cd0-b5bd-43936a7fcefd tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: 5717455e-f92f-432a-b683-bc896e68a78c] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:39.164127 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-950bb766-bfcb-4cd0-b5bd-43936a7fcefd tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:39.164690 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-950bb766-bfcb-4cd0-b5bd-43936a7fcefd tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:39.165608 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-950bb766-bfcb-4cd0-b5bd-43936a7fcefd tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:39.166136 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-950bb766-bfcb-4cd0-b5bd-43936a7fcefd tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:39.210019 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-950bb766-bfcb-4cd0-b5bd-43936a7fcefd tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:39.210680 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-950bb766-bfcb-4cd0-b5bd-43936a7fcefd tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:39.210960 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.objects.instance [None req-950bb766-bfcb-4cd0-b5bd-43936a7fcefd tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lazy-loading 'fault' on Instance uuid 5717455e-f92f-432a-b683-bc896e68a78c {{(pid=117012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:36:39.262146 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-950bb766-bfcb-4cd0-b5bd-43936a7fcefd tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe2917349e43448f38bf960db4bc42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c82837589244f669a18d91e30105e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:39.275260 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-950bb766-bfcb-4cd0-b5bd-43936a7fcefd tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c" status: 200 len: 1304 microversion: 2.1 time: 0.123167 Dec 20 03:36:39.275925 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 515/1041] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:39 2021] GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:36:39.460108 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-7134694e-fc1e-43df-b430-0bd12e44da9e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:39.461412 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-7134694e-fc1e-43df-b430-0bd12e44da9e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:39.468241 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7134694e-fc1e-43df-b430-0bd12e44da9e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:39.468690 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7134694e-fc1e-43df-b430-0bd12e44da9e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:39.469515 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7134694e-fc1e-43df-b430-0bd12e44da9e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:39.469950 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7134694e-fc1e-43df-b430-0bd12e44da9e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:39.485794 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-7134694e-fc1e-43df-b430-0bd12e44da9e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] HTTP exception thrown: Instance 4a1645c1-a90b-406b-ba58-0620598ecf89 could not be found. Dec 20 03:36:39.488770 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-7134694e-fc1e-43df-b430-0bd12e44da9e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Returning 404 to user: Instance 4a1645c1-a90b-406b-ba58-0620598ecf89 could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:36:39.488770 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-7134694e-fc1e-43df-b430-0bd12e44da9e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 404 len: 111 microversion: 2.20 time: 0.033251 Dec 20 03:36:39.493016 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 527/1042] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:36:39 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 20 03:36:39.497905 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7ceebb3a-056e-4f0b-84dc-b496bbc74f65 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '.version_select at 0x7f490881e670>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:39.589563 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7ceebb3a-056e-4f0b-84dc-b496bbc74f65 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964014662" status: 204 len: 0 microversion: 2.20 time: 0.095305 Dec 20 03:36:39.590146 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 516/1043] 10.222.0.53 () {60 vars in 1261 bytes} [Mon Dec 20 03:36:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964014662 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 20 03:36:40.244673 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-8c166190-7349-4bbf-9773-c80d9fd822be req-991a8b94-c26e-4074-8fdf-65dd636691e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5717455e-f92f-432a-b683-bc896e68a78c", "name": "network-vif-deleted", "tag": "e168bfde-ec9d-4c77-a7cf-d39e6607f749"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:36:40.246223 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:36:40.246223 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:36:40.253983 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-8c166190-7349-4bbf-9773-c80d9fd822be req-991a8b94-c26e-4074-8fdf-65dd636691e2 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:40.254677 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-8c166190-7349-4bbf-9773-c80d9fd822be req-991a8b94-c26e-4074-8fdf-65dd636691e2 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:40.267610 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-8c166190-7349-4bbf-9773-c80d9fd822be req-991a8b94-c26e-4074-8fdf-65dd636691e2 service nova] Creating event network-vif-deleted:e168bfde-ec9d-4c77-a7cf-d39e6607f749 for instance 5717455e-f92f-432a-b683-bc896e68a78c on hv-cinder-81803 Dec 20 03:36:40.275625 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-8c166190-7349-4bbf-9773-c80d9fd822be req-991a8b94-c26e-4074-8fdf-65dd636691e2 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034693 Dec 20 03:36:40.276891 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 528/1044] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:36:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:36:40.293081 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f1646424-6fb6-4e29-ba78-6826288f5aa7 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:40.293744 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f1646424-6fb6-4e29-ba78-6826288f5aa7 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] [instance: 5717455e-f92f-432a-b683-bc896e68a78c] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:40.301304 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f1646424-6fb6-4e29-ba78-6826288f5aa7 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:40.301871 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f1646424-6fb6-4e29-ba78-6826288f5aa7 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:40.302731 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f1646424-6fb6-4e29-ba78-6826288f5aa7 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:40.303239 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f1646424-6fb6-4e29-ba78-6826288f5aa7 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:40.318050 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-f1646424-6fb6-4e29-ba78-6826288f5aa7 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] HTTP exception thrown: Instance 5717455e-f92f-432a-b683-bc896e68a78c could not be found. Dec 20 03:36:40.318748 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f1646424-6fb6-4e29-ba78-6826288f5aa7 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] Returning 404 to user: Instance 5717455e-f92f-432a-b683-bc896e68a78c could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:36:40.319609 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f1646424-6fb6-4e29-ba78-6826288f5aa7 tempest-VolumesActionsTest-1696976131 tempest-VolumesActionsTest-1696976131-project] 10.222.0.53 "GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c" status: 404 len: 111 microversion: 2.1 time: 0.030401 Dec 20 03:36:40.320160 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 517/1045] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:36:40 2021] GET /compute/v2.1/servers/5717455e-f92f-432a-b683-bc896e68a78c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:36:40.391077 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-7f1f5a29-7279-4ed9-8346-e626016d4367 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'create', calling method: .version_select at 0x7f49043668b0>, body: {"keypair": {"name": "tempest-keypair-1108431963"}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:36:40.411789 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-7f1f5a29-7279-4ed9-8346-e626016d4367 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Getting quotas for project b0a8965a4b4645829a64cb1f5aec4f44. Resources: {'key_pairs'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:36:40.415918 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-7f1f5a29-7279-4ed9-8346-e626016d4367 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Getting quotas for user 8cedc29bf2c8490db1977aa5613380d7 and project b0a8965a4b4645829a64cb1f5aec4f44. Resources: {'key_pairs'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:36:40.770097 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-7f1f5a29-7279-4ed9-8346-e626016d4367 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Getting quotas for project b0a8965a4b4645829a64cb1f5aec4f44. Resources: {'key_pairs'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:36:40.773851 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-7f1f5a29-7279-4ed9-8346-e626016d4367 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Getting quotas for user 8cedc29bf2c8490db1977aa5613380d7 and project b0a8965a4b4645829a64cb1f5aec4f44. Resources: {'key_pairs'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:36:40.796209 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-7f1f5a29-7279-4ed9-8346-e626016d4367 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.409174 Dec 20 03:36:40.797028 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 529/1046] 10.222.0.53 () {62 vars in 1198 bytes} [Mon Dec 20 03:36:40 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 411 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 20 03:36:43.214798 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ab46b3fe-cb01-440c-9494-92795e2c2e69 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1002908487", "imageRef": "9c4ec443-915b-4997-82d3-08cc97ba635b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99da0c44-2558-4512-bf74-f9aa04dfdd38"}], "security_groups": [{"name": "tempest-securitygroup--1079408967"}], "key_name": "tempest-keypair-1108431963", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:36:43.322179 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.network.neutron [None req-ab46b3fe-cb01-440c-9494-92795e2c2e69 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] validate_networks() for [('99da0c44-2558-4512-bf74-f9aa04dfdd38', None, None, None, None, None)] {{(pid=117012) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:36:43.697425 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-ab46b3fe-cb01-440c-9494-92795e2c2e69 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Flavor limits 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:36:43.697857 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-ab46b3fe-cb01-440c-9494-92795e2c2e69 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Image limits 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:36:43.698344 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-ab46b3fe-cb01-440c-9494-92795e2c2e69 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Flavor pref 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:36:43.698746 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-ab46b3fe-cb01-440c-9494-92795e2c2e69 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Image pref 0:0:0 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:36:43.699162 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.virt.hardware [None req-ab46b3fe-cb01-440c-9494-92795e2c2e69 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:36:43.708662 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ab46b3fe-cb01-440c-9494-92795e2c2e69 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:43.709114 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ab46b3fe-cb01-440c-9494-92795e2c2e69 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:43.710091 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ab46b3fe-cb01-440c-9494-92795e2c2e69 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:43.710549 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ab46b3fe-cb01-440c-9494-92795e2c2e69 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:43.727829 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-ab46b3fe-cb01-440c-9494-92795e2c2e69 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Getting quotas for project b0a8965a4b4645829a64cb1f5aec4f44. Resources: {'instances', 'ram', 'cores'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:36:43.731869 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.quota [None req-ab46b3fe-cb01-440c-9494-92795e2c2e69 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Getting quotas for user 8cedc29bf2c8490db1977aa5613380d7 and project b0a8965a4b4645829a64cb1f5aec4f44. Resources: {'instances', 'ram', 'cores'} {{(pid=117012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:36:43.742724 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ab46b3fe-cb01-440c-9494-92795e2c2e69 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Going to run 1 instances... {{(pid=117012) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:36:43.745060 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ab46b3fe-cb01-440c-9494-92795e2c2e69 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c4ec443-915b-4997-82d3-08cc97ba635b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117012) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:36:43.874738 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ab46b3fe-cb01-440c-9494-92795e2c2e69 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.663735 Dec 20 03:36:43.875368 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 518/1047] 10.222.0.53 () {62 vars in 1187 bytes} [Mon Dec 20 03:36:43 2021] POST /compute/v2.1/servers => generated 402 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 20 03:36:43.886119 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b2b36342-e394-4a11-a541-67226f21d4fe tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:43.886850 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-b2b36342-e394-4a11-a541-67226f21d4fe tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:43.939279 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b2b36342-e394-4a11-a541-67226f21d4fe tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:43.948273 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b2b36342-e394-4a11-a541-67226f21d4fe tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:43.949836 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b2b36342-e394-4a11-a541-67226f21d4fe tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:43.950917 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b2b36342-e394-4a11-a541-67226f21d4fe tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1282 microversion: 2.20 time: 0.068969 Dec 20 03:36:43.951465 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 530/1048] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:36:43 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1282 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:36:44.969346 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-8393f0cf-ef75-422b-9e49-33719db9d62e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:44.970014 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-8393f0cf-ef75-422b-9e49-33719db9d62e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:44.977118 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8393f0cf-ef75-422b-9e49-33719db9d62e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:44.977606 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8393f0cf-ef75-422b-9e49-33719db9d62e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:44.978484 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8393f0cf-ef75-422b-9e49-33719db9d62e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:44.978937 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8393f0cf-ef75-422b-9e49-33719db9d62e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:45.040207 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-8393f0cf-ef75-422b-9e49-33719db9d62e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:45.048001 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-8393f0cf-ef75-422b-9e49-33719db9d62e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:45.049910 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-8393f0cf-ef75-422b-9e49-33719db9d62e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:45.051009 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-8393f0cf-ef75-422b-9e49-33719db9d62e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1286 microversion: 2.20 time: 0.086088 Dec 20 03:36:45.051552 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 519/1049] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:36:44 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:36:46.069469 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-155afa3a-e54c-4c86-b317-6062132c4ceb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:46.070040 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-155afa3a-e54c-4c86-b317-6062132c4ceb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:46.076847 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-155afa3a-e54c-4c86-b317-6062132c4ceb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:46.077412 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-155afa3a-e54c-4c86-b317-6062132c4ceb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:46.078224 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-155afa3a-e54c-4c86-b317-6062132c4ceb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:46.078663 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-155afa3a-e54c-4c86-b317-6062132c4ceb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:46.148487 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-155afa3a-e54c-4c86-b317-6062132c4ceb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:46.157825 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-155afa3a-e54c-4c86-b317-6062132c4ceb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:46.159928 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-155afa3a-e54c-4c86-b317-6062132c4ceb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:46.161052 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-155afa3a-e54c-4c86-b317-6062132c4ceb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1334 microversion: 2.20 time: 0.096257 Dec 20 03:36:46.161655 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 531/1050] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:36:46 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1334 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:36:47.184278 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-cc139356-3bd0-49b4-be64-f364f574d1db tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:47.185734 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-cc139356-3bd0-49b4-be64-f364f574d1db tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:47.194279 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cc139356-3bd0-49b4-be64-f364f574d1db tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:47.195177 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cc139356-3bd0-49b4-be64-f364f574d1db tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:47.196180 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cc139356-3bd0-49b4-be64-f364f574d1db tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:47.196623 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cc139356-3bd0-49b4-be64-f364f574d1db tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:47.314865 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-cc139356-3bd0-49b4-be64-f364f574d1db tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:47.329733 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-cc139356-3bd0-49b4-be64-f364f574d1db tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:47.333791 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-cc139356-3bd0-49b4-be64-f364f574d1db tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:47.337594 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-cc139356-3bd0-49b4-be64-f364f574d1db tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1352 microversion: 2.20 time: 0.156943 Dec 20 03:36:47.341462 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 520/1051] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:36:47 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1352 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:36:48.358954 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-912badce-0450-49a0-a7ec-3679654b0a50 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:48.360336 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-912badce-0450-49a0-a7ec-3679654b0a50 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:48.367772 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-912badce-0450-49a0-a7ec-3679654b0a50 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:48.368495 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-912badce-0450-49a0-a7ec-3679654b0a50 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:48.369588 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-912badce-0450-49a0-a7ec-3679654b0a50 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:48.370262 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-912badce-0450-49a0-a7ec-3679654b0a50 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:48.618230 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-912badce-0450-49a0-a7ec-3679654b0a50 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:48.632589 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-912badce-0450-49a0-a7ec-3679654b0a50 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:48.636079 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-912badce-0450-49a0-a7ec-3679654b0a50 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:48.637275 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-912badce-0450-49a0-a7ec-3679654b0a50 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1408 microversion: 2.20 time: 0.282326 Dec 20 03:36:48.648985 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 532/1052] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:36:48 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1408 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:36:48.895610 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-ea34359b-3d0b-47a6-a982-3d05549e6277 req-3bb15788-0adc-44cf-b083-c7a9e7803c0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7866545-6bb6-419b-8357-857dc5ed59a3", "tag": "aa42babd-fe16-4436-b001-648058d3d1ee"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:36:48.901752 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:36:48.901752 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:36:48.919123 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-ea34359b-3d0b-47a6-a982-3d05549e6277 req-3bb15788-0adc-44cf-b083-c7a9e7803c0a service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:48.919123 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-ea34359b-3d0b-47a6-a982-3d05549e6277 req-3bb15788-0adc-44cf-b083-c7a9e7803c0a service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:48.933792 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-ea34359b-3d0b-47a6-a982-3d05549e6277 req-3bb15788-0adc-44cf-b083-c7a9e7803c0a service nova] Creating event network-changed:aa42babd-fe16-4436-b001-648058d3d1ee for instance d7866545-6bb6-419b-8357-857dc5ed59a3 on hv-cinder-81803 Dec 20 03:36:48.941734 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-ea34359b-3d0b-47a6-a982-3d05549e6277 req-3bb15788-0adc-44cf-b083-c7a9e7803c0a service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057325 Dec 20 03:36:48.943229 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 521/1053] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:36:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:36:49.656222 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-eff4c2b3-e627-4633-813d-436e0a6b7226 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:49.656977 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-eff4c2b3-e627-4633-813d-436e0a6b7226 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:49.664023 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eff4c2b3-e627-4633-813d-436e0a6b7226 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:49.670553 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eff4c2b3-e627-4633-813d-436e0a6b7226 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:49.671477 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eff4c2b3-e627-4633-813d-436e0a6b7226 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:49.671959 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eff4c2b3-e627-4633-813d-436e0a6b7226 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:49.845075 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-eff4c2b3-e627-4633-813d-436e0a6b7226 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:49.863110 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-eff4c2b3-e627-4633-813d-436e0a6b7226 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:49.864623 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-eff4c2b3-e627-4633-813d-436e0a6b7226 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:49.866046 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-eff4c2b3-e627-4633-813d-436e0a6b7226 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1408 microversion: 2.20 time: 0.213749 Dec 20 03:36:49.866610 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 533/1054] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:36:49 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:36:50.887053 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-3064c4fa-78ea-4d39-9505-a441b4975b55 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:50.888008 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-3064c4fa-78ea-4d39-9505-a441b4975b55 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:50.895383 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3064c4fa-78ea-4d39-9505-a441b4975b55 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:50.895834 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3064c4fa-78ea-4d39-9505-a441b4975b55 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:50.896641 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3064c4fa-78ea-4d39-9505-a441b4975b55 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:50.897081 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3064c4fa-78ea-4d39-9505-a441b4975b55 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:51.132327 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-3064c4fa-78ea-4d39-9505-a441b4975b55 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:51.141676 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-3064c4fa-78ea-4d39-9505-a441b4975b55 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:51.144581 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-3064c4fa-78ea-4d39-9505-a441b4975b55 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:51.146026 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-3064c4fa-78ea-4d39-9505-a441b4975b55 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1408 microversion: 2.20 time: 0.264624 Dec 20 03:36:51.156368 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 522/1055] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:36:50 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1408 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:36:52.165060 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-790c1877-1c52-4514-95b7-898b0ac54dfa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:52.165660 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-790c1877-1c52-4514-95b7-898b0ac54dfa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:52.172218 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-790c1877-1c52-4514-95b7-898b0ac54dfa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:52.172747 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-790c1877-1c52-4514-95b7-898b0ac54dfa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:52.173500 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-790c1877-1c52-4514-95b7-898b0ac54dfa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:52.173944 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-790c1877-1c52-4514-95b7-898b0ac54dfa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:52.328357 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-790c1877-1c52-4514-95b7-898b0ac54dfa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:52.339338 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-790c1877-1c52-4514-95b7-898b0ac54dfa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:52.340832 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-790c1877-1c52-4514-95b7-898b0ac54dfa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:52.341945 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-790c1877-1c52-4514-95b7-898b0ac54dfa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1408 microversion: 2.20 time: 0.180785 Dec 20 03:36:52.342942 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 534/1056] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:36:52 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:36:53.363623 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d05e2df0-c0c0-484e-bf5e-9a8b4b6cf640 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:53.364153 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d05e2df0-c0c0-484e-bf5e-9a8b4b6cf640 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:53.373264 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d05e2df0-c0c0-484e-bf5e-9a8b4b6cf640 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:53.373781 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d05e2df0-c0c0-484e-bf5e-9a8b4b6cf640 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:53.374940 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d05e2df0-c0c0-484e-bf5e-9a8b4b6cf640 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:53.375449 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d05e2df0-c0c0-484e-bf5e-9a8b4b6cf640 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:53.530980 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d05e2df0-c0c0-484e-bf5e-9a8b4b6cf640 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:53.543877 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d05e2df0-c0c0-484e-bf5e-9a8b4b6cf640 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:53.546064 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d05e2df0-c0c0-484e-bf5e-9a8b4b6cf640 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:53.550622 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d05e2df0-c0c0-484e-bf5e-9a8b4b6cf640 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1408 microversion: 2.20 time: 0.191222 Dec 20 03:36:53.551383 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 523/1057] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:36:53 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:36:53.915302 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-6d6ab813-8e09-470d-8576-c08c663f72a5 req-52950ae7-00c4-4dd0-a163-4fec058a09c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7866545-6bb6-419b-8357-857dc5ed59a3", "name": "network-vif-plugged", "status": "completed", "tag": "aa42babd-fe16-4436-b001-648058d3d1ee"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:36:53.917267 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:36:53.917267 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:36:53.931671 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-6d6ab813-8e09-470d-8576-c08c663f72a5 req-52950ae7-00c4-4dd0-a163-4fec058a09c5 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:53.932119 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-6d6ab813-8e09-470d-8576-c08c663f72a5 req-52950ae7-00c4-4dd0-a163-4fec058a09c5 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:53.944622 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-6d6ab813-8e09-470d-8576-c08c663f72a5 req-52950ae7-00c4-4dd0-a163-4fec058a09c5 service nova] Creating event network-vif-plugged:aa42babd-fe16-4436-b001-648058d3d1ee for instance d7866545-6bb6-419b-8357-857dc5ed59a3 on hv-cinder-81803 Dec 20 03:36:53.949950 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-6d6ab813-8e09-470d-8576-c08c663f72a5 req-52950ae7-00c4-4dd0-a163-4fec058a09c5 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038567 Dec 20 03:36:53.953675 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 535/1058] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:36:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:36:54.568645 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-bbbb478a-38c3-445f-8763-9946ac470b5e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:54.569382 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-bbbb478a-38c3-445f-8763-9946ac470b5e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:54.576508 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bbbb478a-38c3-445f-8763-9946ac470b5e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:54.576773 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bbbb478a-38c3-445f-8763-9946ac470b5e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:54.577615 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bbbb478a-38c3-445f-8763-9946ac470b5e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:54.578312 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bbbb478a-38c3-445f-8763-9946ac470b5e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:54.761777 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-bbbb478a-38c3-445f-8763-9946ac470b5e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:54.771349 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-bbbb478a-38c3-445f-8763-9946ac470b5e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:54.772869 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-bbbb478a-38c3-445f-8763-9946ac470b5e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:54.774042 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-bbbb478a-38c3-445f-8763-9946ac470b5e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1408 microversion: 2.20 time: 0.209788 Dec 20 03:36:54.785191 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 524/1059] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:36:54 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1408 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:36:55.796152 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ceadcc82-5f16-4849-8024-b96773eccb4f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:55.804346 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ceadcc82-5f16-4849-8024-b96773eccb4f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:55.811043 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ceadcc82-5f16-4849-8024-b96773eccb4f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:55.811578 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ceadcc82-5f16-4849-8024-b96773eccb4f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:55.812292 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ceadcc82-5f16-4849-8024-b96773eccb4f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:55.812727 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ceadcc82-5f16-4849-8024-b96773eccb4f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:55.975775 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ceadcc82-5f16-4849-8024-b96773eccb4f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:55.986997 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ceadcc82-5f16-4849-8024-b96773eccb4f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:55.989337 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ceadcc82-5f16-4849-8024-b96773eccb4f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:55.991021 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ceadcc82-5f16-4849-8024-b96773eccb4f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1408 microversion: 2.20 time: 0.199459 Dec 20 03:36:55.992361 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 536/1060] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:36:55 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:36:57.008994 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-5cff3fbb-156b-4272-a0fd-e8e29682c621 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:57.009802 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-5cff3fbb-156b-4272-a0fd-e8e29682c621 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:57.016348 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5cff3fbb-156b-4272-a0fd-e8e29682c621 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:57.017158 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5cff3fbb-156b-4272-a0fd-e8e29682c621 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:57.018463 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5cff3fbb-156b-4272-a0fd-e8e29682c621 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:57.019252 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5cff3fbb-156b-4272-a0fd-e8e29682c621 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:57.161432 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-5cff3fbb-156b-4272-a0fd-e8e29682c621 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:57.170995 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-5cff3fbb-156b-4272-a0fd-e8e29682c621 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:57.172740 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-5cff3fbb-156b-4272-a0fd-e8e29682c621 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:36:57.174633 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-5cff3fbb-156b-4272-a0fd-e8e29682c621 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1601 microversion: 2.20 time: 0.169351 Dec 20 03:36:57.175228 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 525/1061] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:36:57 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:36:57.191625 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-67a7ec8c-7054-40d7-9561-9aead6ce680d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:36:57.193079 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-67a7ec8c-7054-40d7-9561-9aead6ce680d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:57.199799 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-67a7ec8c-7054-40d7-9561-9aead6ce680d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:57.200490 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-67a7ec8c-7054-40d7-9561-9aead6ce680d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:57.201329 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-67a7ec8c-7054-40d7-9561-9aead6ce680d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:57.201767 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-67a7ec8c-7054-40d7-9561-9aead6ce680d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:57.291078 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-67a7ec8c-7054-40d7-9561-9aead6ce680d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103180 Dec 20 03:36:57.291940 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 537/1062] 10.222.0.53 () {60 vars in 1315 bytes} [Mon Dec 20 03:36:57 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:36:58.502815 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-98582588-29a6-4cc8-9d48-e604de4d5a43 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:36:58.503640 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-98582588-29a6-4cc8-9d48-e604de4d5a43 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:58.506077 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-037a8bd0-c0a6-4f92-9bb2-ecab9db3e535 req-3d0e4093-2b9e-4f63-aa21-1c6044651582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7866545-6bb6-419b-8357-857dc5ed59a3", "tag": "aa42babd-fe16-4436-b001-648058d3d1ee"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:36:58.509022 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:36:58.509022 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:36:58.510493 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-98582588-29a6-4cc8-9d48-e604de4d5a43 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:58.510955 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-98582588-29a6-4cc8-9d48-e604de4d5a43 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:58.511742 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-98582588-29a6-4cc8-9d48-e604de4d5a43 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:58.513057 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-98582588-29a6-4cc8-9d48-e604de4d5a43 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:58.517040 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-037a8bd0-c0a6-4f92-9bb2-ecab9db3e535 req-3d0e4093-2b9e-4f63-aa21-1c6044651582 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:58.517761 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-037a8bd0-c0a6-4f92-9bb2-ecab9db3e535 req-3d0e4093-2b9e-4f63-aa21-1c6044651582 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:58.530689 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-037a8bd0-c0a6-4f92-9bb2-ecab9db3e535 req-3d0e4093-2b9e-4f63-aa21-1c6044651582 service nova] Creating event network-changed:aa42babd-fe16-4436-b001-648058d3d1ee for instance d7866545-6bb6-419b-8357-857dc5ed59a3 on hv-cinder-81803 Dec 20 03:36:58.535954 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-037a8bd0-c0a6-4f92-9bb2-ecab9db3e535 req-3d0e4093-2b9e-4f63-aa21-1c6044651582 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034692 Dec 20 03:36:58.536829 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 538/1063] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:36:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:36:58.623014 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-98582588-29a6-4cc8-9d48-e604de4d5a43 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 14 microversion: 2.20 time: 0.124857 Dec 20 03:36:58.623649 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 526/1064] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:36:58 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:36:59.639259 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d9b9f036-b5ec-44b7-8b64-b2f2e2ac4711 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:36:59.640377 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d9b9f036-b5ec-44b7-8b64-b2f2e2ac4711 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:36:59.656414 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d9b9f036-b5ec-44b7-8b64-b2f2e2ac4711 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:59.656783 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d9b9f036-b5ec-44b7-8b64-b2f2e2ac4711 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:59.658316 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d9b9f036-b5ec-44b7-8b64-b2f2e2ac4711 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:36:59.665434 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d9b9f036-b5ec-44b7-8b64-b2f2e2ac4711 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:36:59.753742 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d9b9f036-b5ec-44b7-8b64-b2f2e2ac4711 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 14 microversion: 2.20 time: 0.119811 Dec 20 03:36:59.757472 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 539/1065] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:36:59 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:00.765933 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-9f04ecd7-dd4d-4ee3-a3d9-67b774e8e6ca tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:00.768767 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-9f04ecd7-dd4d-4ee3-a3d9-67b774e8e6ca tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:00.776367 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9f04ecd7-dd4d-4ee3-a3d9-67b774e8e6ca tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:00.777397 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9f04ecd7-dd4d-4ee3-a3d9-67b774e8e6ca tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:00.778406 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9f04ecd7-dd4d-4ee3-a3d9-67b774e8e6ca tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:00.779150 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-9f04ecd7-dd4d-4ee3-a3d9-67b774e8e6ca tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:00.889361 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-9f04ecd7-dd4d-4ee3-a3d9-67b774e8e6ca tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 14 microversion: 2.20 time: 0.127326 Dec 20 03:37:00.890358 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 527/1066] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:00 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:37:01.903826 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1125a2c1-c299-4236-a712-5158f21d8a1c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:01.905482 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1125a2c1-c299-4236-a712-5158f21d8a1c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:01.918154 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1125a2c1-c299-4236-a712-5158f21d8a1c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:01.919017 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1125a2c1-c299-4236-a712-5158f21d8a1c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:01.919871 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1125a2c1-c299-4236-a712-5158f21d8a1c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:01.920405 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1125a2c1-c299-4236-a712-5158f21d8a1c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:02.022648 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1125a2c1-c299-4236-a712-5158f21d8a1c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 14 microversion: 2.20 time: 0.123407 Dec 20 03:37:02.026172 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 540/1067] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:01 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:03.033843 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d96c6800-0905-4825-8f94-13914d079530 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:03.034871 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d96c6800-0905-4825-8f94-13914d079530 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:03.041887 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d96c6800-0905-4825-8f94-13914d079530 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:03.042340 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d96c6800-0905-4825-8f94-13914d079530 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:03.043115 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d96c6800-0905-4825-8f94-13914d079530 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:03.043554 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d96c6800-0905-4825-8f94-13914d079530 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:03.140703 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d96c6800-0905-4825-8f94-13914d079530 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 14 microversion: 2.20 time: 0.110760 Dec 20 03:37:03.141268 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 528/1068] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:03 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:04.152398 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d4fea6f9-7066-4d3f-a26c-e35ed69aec75 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:04.153977 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d4fea6f9-7066-4d3f-a26c-e35ed69aec75 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:04.160704 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d4fea6f9-7066-4d3f-a26c-e35ed69aec75 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:04.161175 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d4fea6f9-7066-4d3f-a26c-e35ed69aec75 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:04.161983 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d4fea6f9-7066-4d3f-a26c-e35ed69aec75 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:04.162418 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d4fea6f9-7066-4d3f-a26c-e35ed69aec75 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:04.248230 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d4fea6f9-7066-4d3f-a26c-e35ed69aec75 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 14 microversion: 2.20 time: 0.099777 Dec 20 03:37:04.248868 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 541/1069] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:04 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:05.260624 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ea13ba5e-45d4-4294-9a38-10b82ba5da05 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:05.261548 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ea13ba5e-45d4-4294-9a38-10b82ba5da05 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:05.268796 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ea13ba5e-45d4-4294-9a38-10b82ba5da05 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:05.269263 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ea13ba5e-45d4-4294-9a38-10b82ba5da05 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:05.270050 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ea13ba5e-45d4-4294-9a38-10b82ba5da05 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:05.270485 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ea13ba5e-45d4-4294-9a38-10b82ba5da05 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:05.358355 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ea13ba5e-45d4-4294-9a38-10b82ba5da05 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 14 microversion: 2.20 time: 0.101867 Dec 20 03:37:05.358989 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 529/1070] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:05 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:37:06.371255 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-07f1e2b2-524f-4b87-977f-88c6fb17f6bc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:06.371255 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-07f1e2b2-524f-4b87-977f-88c6fb17f6bc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:06.378156 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-07f1e2b2-524f-4b87-977f-88c6fb17f6bc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:06.378612 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-07f1e2b2-524f-4b87-977f-88c6fb17f6bc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:06.379510 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-07f1e2b2-524f-4b87-977f-88c6fb17f6bc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:06.379947 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-07f1e2b2-524f-4b87-977f-88c6fb17f6bc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:06.480483 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-07f1e2b2-524f-4b87-977f-88c6fb17f6bc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 14 microversion: 2.20 time: 0.114471 Dec 20 03:37:06.481585 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 542/1071] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:06 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:07.492051 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-5e6a4771-8ed3-4497-ba9a-3e90dc62247c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:07.493059 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-5e6a4771-8ed3-4497-ba9a-3e90dc62247c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:07.500246 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5e6a4771-8ed3-4497-ba9a-3e90dc62247c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:07.500705 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5e6a4771-8ed3-4497-ba9a-3e90dc62247c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:07.502407 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5e6a4771-8ed3-4497-ba9a-3e90dc62247c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:07.502973 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5e6a4771-8ed3-4497-ba9a-3e90dc62247c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:07.588113 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-5e6a4771-8ed3-4497-ba9a-3e90dc62247c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 14 microversion: 2.20 time: 0.099951 Dec 20 03:37:07.588729 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 530/1072] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:07 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:08.599629 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-bde6f7e4-86bb-4fc9-b9db-ed267d35474b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:08.600650 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-bde6f7e4-86bb-4fc9-b9db-ed267d35474b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:08.607811 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bde6f7e4-86bb-4fc9-b9db-ed267d35474b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:08.608205 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bde6f7e4-86bb-4fc9-b9db-ed267d35474b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:08.608994 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bde6f7e4-86bb-4fc9-b9db-ed267d35474b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:08.609459 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bde6f7e4-86bb-4fc9-b9db-ed267d35474b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:08.713014 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-bde6f7e4-86bb-4fc9-b9db-ed267d35474b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 5649 microversion: 2.20 time: 0.117937 Dec 20 03:37:08.713927 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 543/1073] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:08 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 5649 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:37:09.725102 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e0bf5278-8bcf-4082-b4df-5436b7be8ad0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:09.726143 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e0bf5278-8bcf-4082-b4df-5436b7be8ad0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:09.732958 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e0bf5278-8bcf-4082-b4df-5436b7be8ad0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:09.733476 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e0bf5278-8bcf-4082-b4df-5436b7be8ad0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:09.734257 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e0bf5278-8bcf-4082-b4df-5436b7be8ad0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:09.734701 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e0bf5278-8bcf-4082-b4df-5436b7be8ad0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:09.835399 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e0bf5278-8bcf-4082-b4df-5436b7be8ad0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 15025 microversion: 2.20 time: 0.114245 Dec 20 03:37:09.836527 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 531/1074] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:09 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 15025 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:10.847912 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d0c4904b-057a-4706-8b2a-436f8f65496f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:10.848914 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d0c4904b-057a-4706-8b2a-436f8f65496f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:10.855976 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d0c4904b-057a-4706-8b2a-436f8f65496f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:10.862743 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d0c4904b-057a-4706-8b2a-436f8f65496f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:10.862743 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d0c4904b-057a-4706-8b2a-436f8f65496f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:10.862743 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d0c4904b-057a-4706-8b2a-436f8f65496f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:10.973348 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d0c4904b-057a-4706-8b2a-436f8f65496f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 18398 microversion: 2.20 time: 0.129812 Dec 20 03:37:10.974254 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 544/1075] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:10 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 18398 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 03:37:11.984409 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c7b551ea-4e39-4369-b6f4-ac33258dcf77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:11.985445 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c7b551ea-4e39-4369-b6f4-ac33258dcf77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:11.992548 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c7b551ea-4e39-4369-b6f4-ac33258dcf77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:11.993002 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c7b551ea-4e39-4369-b6f4-ac33258dcf77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:11.993825 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c7b551ea-4e39-4369-b6f4-ac33258dcf77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:11.994267 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c7b551ea-4e39-4369-b6f4-ac33258dcf77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:13.786851 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c7b551ea-4e39-4369-b6f4-ac33258dcf77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 23228 microversion: 2.20 time: 1.806337 Dec 20 03:37:13.787546 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 532/1076] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:11 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 23228 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:14.799572 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-85318a29-bb6f-4c77-ad5f-f3f180a61661 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:14.800566 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-85318a29-bb6f-4c77-ad5f-f3f180a61661 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:14.807700 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-85318a29-bb6f-4c77-ad5f-f3f180a61661 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:14.808149 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-85318a29-bb6f-4c77-ad5f-f3f180a61661 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:14.808937 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-85318a29-bb6f-4c77-ad5f-f3f180a61661 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:14.809396 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-85318a29-bb6f-4c77-ad5f-f3f180a61661 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:14.916116 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-85318a29-bb6f-4c77-ad5f-f3f180a61661 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 24254 microversion: 2.20 time: 0.120871 Dec 20 03:37:14.916878 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 545/1077] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:14 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 24254 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:15.928934 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-6727b3b0-595d-4d89-b208-ea36d8b95c6c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:15.929971 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6727b3b0-595d-4d89-b208-ea36d8b95c6c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:15.937416 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6727b3b0-595d-4d89-b208-ea36d8b95c6c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:15.937868 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6727b3b0-595d-4d89-b208-ea36d8b95c6c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:15.938686 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6727b3b0-595d-4d89-b208-ea36d8b95c6c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:15.939120 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6727b3b0-595d-4d89-b208-ea36d8b95c6c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:18.126198 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-6727b3b0-595d-4d89-b208-ea36d8b95c6c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 27599 microversion: 2.20 time: 2.201003 Dec 20 03:37:18.126866 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 533/1078] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:15 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 27599 bytes in 2203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:19.138352 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-4d79586c-28bb-451d-983f-1eb8781064dd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:19.139396 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-4d79586c-28bb-451d-983f-1eb8781064dd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:19.147581 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4d79586c-28bb-451d-983f-1eb8781064dd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:19.148043 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4d79586c-28bb-451d-983f-1eb8781064dd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:19.148905 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4d79586c-28bb-451d-983f-1eb8781064dd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:19.149403 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4d79586c-28bb-451d-983f-1eb8781064dd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:19.250899 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-4d79586c-28bb-451d-983f-1eb8781064dd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 27949 microversion: 2.20 time: 0.116462 Dec 20 03:37:19.251804 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 546/1079] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:19 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 27949 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 03:37:20.263241 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d370369d-d3be-45f3-9cd7-fc936ff61afa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:20.264162 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d370369d-d3be-45f3-9cd7-fc936ff61afa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:20.272445 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d370369d-d3be-45f3-9cd7-fc936ff61afa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:20.272901 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d370369d-d3be-45f3-9cd7-fc936ff61afa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:20.273806 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d370369d-d3be-45f3-9cd7-fc936ff61afa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:20.274248 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d370369d-d3be-45f3-9cd7-fc936ff61afa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:22.826877 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d370369d-d3be-45f3-9cd7-fc936ff61afa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 28245 microversion: 2.20 time: 2.567586 Dec 20 03:37:22.827519 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 534/1080] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:20 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 28245 bytes in 2569 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:23.842852 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-606f52da-9ba8-4912-b37b-9e343e0da2be tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:23.843838 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-606f52da-9ba8-4912-b37b-9e343e0da2be tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:23.851844 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-606f52da-9ba8-4912-b37b-9e343e0da2be tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:23.852376 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-606f52da-9ba8-4912-b37b-9e343e0da2be tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:23.853192 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-606f52da-9ba8-4912-b37b-9e343e0da2be tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:23.853635 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-606f52da-9ba8-4912-b37b-9e343e0da2be tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:23.951629 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-606f52da-9ba8-4912-b37b-9e343e0da2be tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 28245 microversion: 2.20 time: 0.112510 Dec 20 03:37:23.952390 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 547/1081] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:23 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 28245 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:24.964463 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ed2b0916-cd2d-40f7-9444-1f5cde8779fb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:24.965488 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ed2b0916-cd2d-40f7-9444-1f5cde8779fb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:24.973219 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ed2b0916-cd2d-40f7-9444-1f5cde8779fb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:24.974411 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ed2b0916-cd2d-40f7-9444-1f5cde8779fb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:24.975266 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ed2b0916-cd2d-40f7-9444-1f5cde8779fb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:24.975710 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ed2b0916-cd2d-40f7-9444-1f5cde8779fb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:25.076538 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ed2b0916-cd2d-40f7-9444-1f5cde8779fb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 28260 microversion: 2.20 time: 0.116019 Dec 20 03:37:25.077193 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 535/1082] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:24 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 28260 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:26.089164 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-64ac9bc9-6737-49ca-b242-b1058141b69d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:26.090217 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-64ac9bc9-6737-49ca-b242-b1058141b69d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:26.097381 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-64ac9bc9-6737-49ca-b242-b1058141b69d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:26.097837 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-64ac9bc9-6737-49ca-b242-b1058141b69d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:26.098621 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-64ac9bc9-6737-49ca-b242-b1058141b69d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:26.099065 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-64ac9bc9-6737-49ca-b242-b1058141b69d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:26.194921 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-64ac9bc9-6737-49ca-b242-b1058141b69d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 28536 microversion: 2.20 time: 0.109929 Dec 20 03:37:26.195558 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 548/1083] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:26 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 28536 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:27.207569 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-daa1b785-57ee-42ec-9b4c-219bf9dee333 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:27.208486 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-daa1b785-57ee-42ec-9b4c-219bf9dee333 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:27.215850 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-daa1b785-57ee-42ec-9b4c-219bf9dee333 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:27.216297 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-daa1b785-57ee-42ec-9b4c-219bf9dee333 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:27.217114 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-daa1b785-57ee-42ec-9b4c-219bf9dee333 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:27.217570 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-daa1b785-57ee-42ec-9b4c-219bf9dee333 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:27.318845 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-daa1b785-57ee-42ec-9b4c-219bf9dee333 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 28704 microversion: 2.20 time: 0.114666 Dec 20 03:37:27.319522 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 536/1084] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:27 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 28704 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 03:37:28.330932 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-35a6cb89-a73f-4f1f-b149-e77b6e8d0018 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:28.331968 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-35a6cb89-a73f-4f1f-b149-e77b6e8d0018 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:28.339755 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-35a6cb89-a73f-4f1f-b149-e77b6e8d0018 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:28.340190 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-35a6cb89-a73f-4f1f-b149-e77b6e8d0018 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:28.340975 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-35a6cb89-a73f-4f1f-b149-e77b6e8d0018 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:28.341438 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-35a6cb89-a73f-4f1f-b149-e77b6e8d0018 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:28.442263 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-35a6cb89-a73f-4f1f-b149-e77b6e8d0018 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 28704 microversion: 2.20 time: 0.115196 Dec 20 03:37:28.443445 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 549/1085] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:28 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 28704 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:29.454691 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-44edcfb5-65cf-451c-9e9f-b0d55a082d38 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:29.455704 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-44edcfb5-65cf-451c-9e9f-b0d55a082d38 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:29.463584 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-44edcfb5-65cf-451c-9e9f-b0d55a082d38 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:29.464038 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-44edcfb5-65cf-451c-9e9f-b0d55a082d38 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:29.464846 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-44edcfb5-65cf-451c-9e9f-b0d55a082d38 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:29.465316 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-44edcfb5-65cf-451c-9e9f-b0d55a082d38 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:29.557499 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-44edcfb5-65cf-451c-9e9f-b0d55a082d38 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 28704 microversion: 2.20 time: 0.106539 Dec 20 03:37:29.561455 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 537/1086] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:29 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 28704 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:30.569812 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-6276c501-52ae-484e-83f5-3d2ec08857a8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:30.570807 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6276c501-52ae-484e-83f5-3d2ec08857a8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:30.577727 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6276c501-52ae-484e-83f5-3d2ec08857a8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:30.578185 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6276c501-52ae-484e-83f5-3d2ec08857a8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:30.579005 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6276c501-52ae-484e-83f5-3d2ec08857a8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:30.579484 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6276c501-52ae-484e-83f5-3d2ec08857a8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:30.719656 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-6276c501-52ae-484e-83f5-3d2ec08857a8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 28704 microversion: 2.20 time: 0.153808 Dec 20 03:37:30.720497 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 550/1087] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:30 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 28704 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:31.731654 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-3d43e5ed-c5b5-46f3-976b-fa2fc00bf7f8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:31.732641 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-3d43e5ed-c5b5-46f3-976b-fa2fc00bf7f8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:31.739527 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3d43e5ed-c5b5-46f3-976b-fa2fc00bf7f8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:31.740965 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3d43e5ed-c5b5-46f3-976b-fa2fc00bf7f8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:31.741775 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3d43e5ed-c5b5-46f3-976b-fa2fc00bf7f8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:31.742208 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3d43e5ed-c5b5-46f3-976b-fa2fc00bf7f8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:31.838216 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-3d43e5ed-c5b5-46f3-976b-fa2fc00bf7f8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 30340 microversion: 2.20 time: 0.110336 Dec 20 03:37:31.838865 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 538/1088] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:31 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 30340 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:32.850804 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-6b0cb0be-5904-4c84-8353-1b22672728b6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:32.851857 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-6b0cb0be-5904-4c84-8353-1b22672728b6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:32.858974 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6b0cb0be-5904-4c84-8353-1b22672728b6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:32.859428 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6b0cb0be-5904-4c84-8353-1b22672728b6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:32.860211 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6b0cb0be-5904-4c84-8353-1b22672728b6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:32.860769 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-6b0cb0be-5904-4c84-8353-1b22672728b6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:32.954904 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-6b0cb0be-5904-4c84-8353-1b22672728b6 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 32375 microversion: 2.20 time: 0.108062 Dec 20 03:37:32.955811 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 551/1089] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:32 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 32375 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:33.967833 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-8bc93bd4-a603-4ec2-83f5-b21d1ba56bec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:33.968822 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-8bc93bd4-a603-4ec2-83f5-b21d1ba56bec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:33.976290 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8bc93bd4-a603-4ec2-83f5-b21d1ba56bec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:33.976740 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8bc93bd4-a603-4ec2-83f5-b21d1ba56bec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:33.977534 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8bc93bd4-a603-4ec2-83f5-b21d1ba56bec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:33.977971 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8bc93bd4-a603-4ec2-83f5-b21d1ba56bec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:33.989161 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-73eb0424-d0e7-41ca-ba78-6ce718d40c4f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:33.989756 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-73eb0424-d0e7-41ca-ba78-6ce718d40c4f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:33.996812 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-73eb0424-d0e7-41ca-ba78-6ce718d40c4f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:33.997333 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-73eb0424-d0e7-41ca-ba78-6ce718d40c4f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:33.998124 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-73eb0424-d0e7-41ca-ba78-6ce718d40c4f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:33.998568 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-73eb0424-d0e7-41ca-ba78-6ce718d40c4f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:34.025599 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-73eb0424-d0e7-41ca-ba78-6ce718d40c4f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Going to try to terminate instance {{(pid=117011) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:37:34.079350 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-8bc93bd4-a603-4ec2-83f5-b21d1ba56bec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 33553 microversion: 2.20 time: 0.115353 Dec 20 03:37:34.083925 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 539/1090] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:33 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 33553 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:34.345655 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-73eb0424-d0e7-41ca-ba78-6ce718d40c4f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "DELETE /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 204 len: 0 microversion: 2.1 time: 0.360144 Dec 20 03:37:34.347056 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 552/1091] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:37:33 2021] DELETE /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 20 03:37:34.355872 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-90b9bc74-13e2-4191-80bf-6960dfefd8d2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:34.356580 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-90b9bc74-13e2-4191-80bf-6960dfefd8d2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:34.363501 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-90b9bc74-13e2-4191-80bf-6960dfefd8d2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:34.363949 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-90b9bc74-13e2-4191-80bf-6960dfefd8d2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:34.368601 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-90b9bc74-13e2-4191-80bf-6960dfefd8d2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:34.368601 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-90b9bc74-13e2-4191-80bf-6960dfefd8d2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:34.502791 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-90b9bc74-13e2-4191-80bf-6960dfefd8d2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:34.511294 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-90b9bc74-13e2-4191-80bf-6960dfefd8d2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1579 microversion: 2.1 time: 0.159404 Dec 20 03:37:34.511866 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 540/1092] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:34 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1579 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:37:35.094533 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f615f8a3-d4b4-4426-a3ec-08d5bfefcf77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:35.095436 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-f615f8a3-d4b4-4426-a3ec-08d5bfefcf77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:35.102695 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f615f8a3-d4b4-4426-a3ec-08d5bfefcf77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:35.103144 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f615f8a3-d4b4-4426-a3ec-08d5bfefcf77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:35.103917 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f615f8a3-d4b4-4426-a3ec-08d5bfefcf77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:35.104348 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f615f8a3-d4b4-4426-a3ec-08d5bfefcf77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:35.199789 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f615f8a3-d4b4-4426-a3ec-08d5bfefcf77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 34359 microversion: 2.20 time: 0.109260 Dec 20 03:37:35.200452 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 553/1093] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:35 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 34359 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:35.530951 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-36794684-51cb-49b6-bf97-59924692fb5b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:35.531501 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-36794684-51cb-49b6-bf97-59924692fb5b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:35.537729 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-36794684-51cb-49b6-bf97-59924692fb5b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:35.538402 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-36794684-51cb-49b6-bf97-59924692fb5b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:35.539262 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-36794684-51cb-49b6-bf97-59924692fb5b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:35.539708 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-36794684-51cb-49b6-bf97-59924692fb5b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:35.675593 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-36794684-51cb-49b6-bf97-59924692fb5b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:35.683952 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-36794684-51cb-49b6-bf97-59924692fb5b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1579 microversion: 2.1 time: 0.156809 Dec 20 03:37:35.684532 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 541/1094] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:35 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:36.212681 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-797426ab-7a0b-42b0-b72e-add4e6cb09d8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:36.213615 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-797426ab-7a0b-42b0-b72e-add4e6cb09d8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:36.220495 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-797426ab-7a0b-42b0-b72e-add4e6cb09d8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:36.220950 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-797426ab-7a0b-42b0-b72e-add4e6cb09d8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:36.221767 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-797426ab-7a0b-42b0-b72e-add4e6cb09d8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:36.222208 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-797426ab-7a0b-42b0-b72e-add4e6cb09d8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:36.315668 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-797426ab-7a0b-42b0-b72e-add4e6cb09d8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 35271 microversion: 2.20 time: 0.107527 Dec 20 03:37:36.316291 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 554/1095] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:36 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 35271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:36.700904 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-6c057f8e-6968-4224-950e-4149e10b0553 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:36.701549 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-6c057f8e-6968-4224-950e-4149e10b0553 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:36.707853 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6c057f8e-6968-4224-950e-4149e10b0553 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:36.708305 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6c057f8e-6968-4224-950e-4149e10b0553 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:36.709085 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6c057f8e-6968-4224-950e-4149e10b0553 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:36.709554 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-6c057f8e-6968-4224-950e-4149e10b0553 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:36.946504 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-6c057f8e-6968-4224-950e-4149e10b0553 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:36.953859 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-6c057f8e-6968-4224-950e-4149e10b0553 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1579 microversion: 2.1 time: 0.256651 Dec 20 03:37:36.954421 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 542/1096] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:36 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1579 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:37.328345 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-83010e6d-677d-4a05-b45d-fb6cdbbc12aa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:37.329793 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-83010e6d-677d-4a05-b45d-fb6cdbbc12aa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:37.337399 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-83010e6d-677d-4a05-b45d-fb6cdbbc12aa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:37.337926 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-83010e6d-677d-4a05-b45d-fb6cdbbc12aa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:37.338840 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-83010e6d-677d-4a05-b45d-fb6cdbbc12aa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:37.339553 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-83010e6d-677d-4a05-b45d-fb6cdbbc12aa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:37.385033 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-b5cba977-a447-4bb2-bb38-5d5015de4866 req-12bdbf04-60bb-4435-860a-357ec6c91a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b572f265-bb17-4489-a53a-432eb4815ac6", "name": "network-vif-deleted", "tag": "18e4f61a-85b3-4ab2-9fc5-c5bd02019210"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:37.386616 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:37:37.386616 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:37:37.395366 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-b5cba977-a447-4bb2-bb38-5d5015de4866 req-12bdbf04-60bb-4435-860a-357ec6c91a0d service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:37.395823 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-b5cba977-a447-4bb2-bb38-5d5015de4866 req-12bdbf04-60bb-4435-860a-357ec6c91a0d service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:37.409783 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-b5cba977-a447-4bb2-bb38-5d5015de4866 req-12bdbf04-60bb-4435-860a-357ec6c91a0d service nova] Creating event network-vif-deleted:18e4f61a-85b3-4ab2-9fc5-c5bd02019210 for instance b572f265-bb17-4489-a53a-432eb4815ac6 on hv-cinder-81803 Dec 20 03:37:37.415845 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-b5cba977-a447-4bb2-bb38-5d5015de4866 req-12bdbf04-60bb-4435-860a-357ec6c91a0d service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034558 Dec 20 03:37:37.416445 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 543/1097] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:37:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:37:37.438516 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-83010e6d-677d-4a05-b45d-fb6cdbbc12aa tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 36683 microversion: 2.20 time: 0.114150 Dec 20 03:37:37.439172 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 555/1098] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:37 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 36683 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:37.971374 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-3e44d448-ccd9-4900-bbfd-ed8ad0743029 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:37.972196 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-3e44d448-ccd9-4900-bbfd-ed8ad0743029 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:37.978999 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3e44d448-ccd9-4900-bbfd-ed8ad0743029 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:37.979576 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3e44d448-ccd9-4900-bbfd-ed8ad0743029 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:37.981173 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3e44d448-ccd9-4900-bbfd-ed8ad0743029 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:37.981173 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3e44d448-ccd9-4900-bbfd-ed8ad0743029 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:38.046828 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-3e44d448-ccd9-4900-bbfd-ed8ad0743029 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:38.054854 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-3e44d448-ccd9-4900-bbfd-ed8ad0743029 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 200 len: 1225 microversion: 2.1 time: 0.087404 Dec 20 03:37:38.055390 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 544/1099] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:37 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:37:38.451785 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-eee21b7e-02f2-4aa2-8109-b0beef8bf77a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:38.452681 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-eee21b7e-02f2-4aa2-8109-b0beef8bf77a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:38.459662 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eee21b7e-02f2-4aa2-8109-b0beef8bf77a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:38.461768 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eee21b7e-02f2-4aa2-8109-b0beef8bf77a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:38.462806 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eee21b7e-02f2-4aa2-8109-b0beef8bf77a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:38.463139 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-eee21b7e-02f2-4aa2-8109-b0beef8bf77a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:38.568148 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-eee21b7e-02f2-4aa2-8109-b0beef8bf77a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 37991 microversion: 2.20 time: 0.120392 Dec 20 03:37:38.568802 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 556/1100] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:38 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 37991 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:39.071676 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c8f14267-e2c2-4e7b-a717-09158c27b4e5 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:39.072412 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c8f14267-e2c2-4e7b-a717-09158c27b4e5 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:39.078860 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c8f14267-e2c2-4e7b-a717-09158c27b4e5 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:39.079315 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c8f14267-e2c2-4e7b-a717-09158c27b4e5 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:39.080093 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c8f14267-e2c2-4e7b-a717-09158c27b4e5 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:39.080600 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c8f14267-e2c2-4e7b-a717-09158c27b4e5 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:39.094316 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-c8f14267-e2c2-4e7b-a717-09158c27b4e5 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] HTTP exception thrown: Instance b572f265-bb17-4489-a53a-432eb4815ac6 could not be found. Dec 20 03:37:39.094836 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c8f14267-e2c2-4e7b-a717-09158c27b4e5 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Returning 404 to user: Instance b572f265-bb17-4489-a53a-432eb4815ac6 could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:37:39.095648 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c8f14267-e2c2-4e7b-a717-09158c27b4e5 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 404 len: 111 microversion: 2.1 time: 0.028047 Dec 20 03:37:39.096175 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 545/1101] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:39 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:37:39.196713 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-11539f65-bd37-4102-8281-1616404dcc57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1874596409", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-832830598", "security_groups": [{"name": "tempest-secgroup-smoke-1005542187"}], "block_device_mapping_v2": [{"uuid": "8cfde632-fe6e-47f4-9132-290483e1cc86", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "247f1037-2c21-483f-b1d2-d9c7b96998be"}]}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:39.312149 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.network.neutron [None req-11539f65-bd37-4102-8281-1616404dcc57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] validate_networks() for [('247f1037-2c21-483f-b1d2-d9c7b96998be', None, None, None, None, None)] {{(pid=117011) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:37:39.579747 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-b75d3770-0cbf-443f-a342-1b0816b5bb57 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:39.580713 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-b75d3770-0cbf-443f-a342-1b0816b5bb57 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:39.587402 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b75d3770-0cbf-443f-a342-1b0816b5bb57 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:39.588073 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b75d3770-0cbf-443f-a342-1b0816b5bb57 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:39.588862 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b75d3770-0cbf-443f-a342-1b0816b5bb57 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:39.589330 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b75d3770-0cbf-443f-a342-1b0816b5bb57 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:39.678140 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-11539f65-bd37-4102-8281-1616404dcc57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Flavor limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:37:39.678630 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-11539f65-bd37-4102-8281-1616404dcc57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Image limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:37:39.679052 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-11539f65-bd37-4102-8281-1616404dcc57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Flavor pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:37:39.680109 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-11539f65-bd37-4102-8281-1616404dcc57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Image pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:37:39.680532 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-11539f65-bd37-4102-8281-1616404dcc57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:37:39.689577 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-b75d3770-0cbf-443f-a342-1b0816b5bb57 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 38261 microversion: 2.20 time: 0.113219 Dec 20 03:37:39.689784 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-11539f65-bd37-4102-8281-1616404dcc57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:39.690062 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-11539f65-bd37-4102-8281-1616404dcc57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:39.690552 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 546/1102] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:39 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 38261 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 03:37:39.690880 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-11539f65-bd37-4102-8281-1616404dcc57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:39.691315 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-11539f65-bd37-4102-8281-1616404dcc57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:39.708340 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-11539f65-bd37-4102-8281-1616404dcc57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Getting quotas for project d4fa0cffd767432cae1c69fa4e26e6c5. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:37:39.712282 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-11539f65-bd37-4102-8281-1616404dcc57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Getting quotas for user 0a13354364b2443cb3ba387ec4893d67 and project d4fa0cffd767432cae1c69fa4e26e6c5. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:37:39.768518 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-11539f65-bd37-4102-8281-1616404dcc57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Going to run 1 instances... {{(pid=117011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:37:39.770813 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-11539f65-bd37-4102-8281-1616404dcc57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8cfde632-fe6e-47f4-9132-290483e1cc86',volume_size=None,volume_type=None)] {{(pid=117011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:37:40.181342 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-11539f65-bd37-4102-8281-1616404dcc57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.988615 Dec 20 03:37:40.182240 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 557/1103] 10.222.0.53 () {60 vars in 1146 bytes} [Mon Dec 20 03:37:39 2021] POST /compute/v2.1/servers => generated 406 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 03:37:40.192544 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e11e480c-0376-486e-8b92-7afc29ed7480 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:40.194049 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e11e480c-0376-486e-8b92-7afc29ed7480 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:40.213635 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e289a13b-3400-449e-bfec-a42402c24a89 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:40.215359 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e289a13b-3400-449e-bfec-a42402c24a89 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:40.224629 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e289a13b-3400-449e-bfec-a42402c24a89 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:40.225356 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e289a13b-3400-449e-bfec-a42402c24a89 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:40.226390 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e289a13b-3400-449e-bfec-a42402c24a89 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:40.226984 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e289a13b-3400-449e-bfec-a42402c24a89 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:40.254758 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-e11e480c-0376-486e-8b92-7afc29ed7480 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:40.257744 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e289a13b-3400-449e-bfec-a42402c24a89 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Going to try to terminate instance {{(pid=117011) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:37:40.264881 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e11e480c-0376-486e-8b92-7afc29ed7480 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1094 microversion: 2.1 time: 0.076287 Dec 20 03:37:40.269002 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 547/1104] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:40 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:40.277465 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-c2133ae1-60ee-4562-b60a-486c62962166 req-95f60cb2-8125-40b4-9625-7a8e7ca5649b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc84db6-8d02-4fd4-b38c-c0a90f104993", "tag": "dcafb0f8-ea15-4cf6-ace1-0817393056e3"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:40.280573 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:37:40.280573 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:37:40.291105 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-c2133ae1-60ee-4562-b60a-486c62962166 req-95f60cb2-8125-40b4-9625-7a8e7ca5649b service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:40.291647 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-c2133ae1-60ee-4562-b60a-486c62962166 req-95f60cb2-8125-40b4-9625-7a8e7ca5649b service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:40.306688 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-c2133ae1-60ee-4562-b60a-486c62962166 req-95f60cb2-8125-40b4-9625-7a8e7ca5649b service nova] Creating event network-changed:dcafb0f8-ea15-4cf6-ace1-0817393056e3 for instance 3cc84db6-8d02-4fd4-b38c-c0a90f104993 on hv-cinder-81803 Dec 20 03:37:40.313024 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-c2133ae1-60ee-4562-b60a-486c62962166 req-95f60cb2-8125-40b4-9625-7a8e7ca5649b service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041853 Dec 20 03:37:40.314001 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 548/1105] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:37:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:37:40.594045 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e289a13b-3400-449e-bfec-a42402c24a89 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "DELETE /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 204 len: 0 microversion: 2.1 time: 0.383830 Dec 20 03:37:40.595013 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 558/1106] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:37:40 2021] DELETE /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:37:40.604111 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-647bfff8-92da-4cb8-b233-c72631ac7bfe tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:40.605084 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-647bfff8-92da-4cb8-b233-c72631ac7bfe tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:40.611472 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-647bfff8-92da-4cb8-b233-c72631ac7bfe tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:40.612218 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-647bfff8-92da-4cb8-b233-c72631ac7bfe tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:40.613228 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-647bfff8-92da-4cb8-b233-c72631ac7bfe tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:40.613826 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-647bfff8-92da-4cb8-b233-c72631ac7bfe tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:40.704314 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-5d37bc78-8ea6-421d-af33-fef2730d9a4b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:40.709253 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-5d37bc78-8ea6-421d-af33-fef2730d9a4b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:40.731315 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5d37bc78-8ea6-421d-af33-fef2730d9a4b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:40.731774 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5d37bc78-8ea6-421d-af33-fef2730d9a4b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:40.732670 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5d37bc78-8ea6-421d-af33-fef2730d9a4b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:40.733108 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5d37bc78-8ea6-421d-af33-fef2730d9a4b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:40.832494 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-5d37bc78-8ea6-421d-af33-fef2730d9a4b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 38261 microversion: 2.20 time: 0.133100 Dec 20 03:37:40.833419 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 559/1107] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:40 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 38261 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:40.872246 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-647bfff8-92da-4cb8-b233-c72631ac7bfe tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:40.877885 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-647bfff8-92da-4cb8-b233-c72631ac7bfe tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1566 microversion: 2.1 time: 0.278398 Dec 20 03:37:40.878467 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 549/1108] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:40 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1566 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:41.282645 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-a9e453ce-4649-4e5e-83ea-0478f5e51952 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:41.283329 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-a9e453ce-4649-4e5e-83ea-0478f5e51952 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:41.290347 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a9e453ce-4649-4e5e-83ea-0478f5e51952 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:41.291042 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a9e453ce-4649-4e5e-83ea-0478f5e51952 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:41.291986 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a9e453ce-4649-4e5e-83ea-0478f5e51952 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:41.292576 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-a9e453ce-4649-4e5e-83ea-0478f5e51952 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:41.363622 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-a9e453ce-4649-4e5e-83ea-0478f5e51952 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:41.370340 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-a9e453ce-4649-4e5e-83ea-0478f5e51952 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1144 microversion: 2.1 time: 0.091553 Dec 20 03:37:41.370917 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 560/1109] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:41 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:41.844375 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-09617e73-3e2d-49d4-9bda-8d40277f9f42 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:41.845410 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-09617e73-3e2d-49d4-9bda-8d40277f9f42 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:41.851899 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-09617e73-3e2d-49d4-9bda-8d40277f9f42 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:41.852506 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-09617e73-3e2d-49d4-9bda-8d40277f9f42 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:41.853121 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-09617e73-3e2d-49d4-9bda-8d40277f9f42 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:41.853603 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-09617e73-3e2d-49d4-9bda-8d40277f9f42 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:41.895206 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-846304a0-5688-40ad-b9b2-4f4c13fe13a3 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:41.895801 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-846304a0-5688-40ad-b9b2-4f4c13fe13a3 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:41.902910 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-846304a0-5688-40ad-b9b2-4f4c13fe13a3 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:41.903353 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-846304a0-5688-40ad-b9b2-4f4c13fe13a3 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:41.904793 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-846304a0-5688-40ad-b9b2-4f4c13fe13a3 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:41.905265 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-846304a0-5688-40ad-b9b2-4f4c13fe13a3 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:41.943581 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-09617e73-3e2d-49d4-9bda-8d40277f9f42 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 38261 microversion: 2.20 time: 0.102837 Dec 20 03:37:41.944243 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 550/1110] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:41 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 38261 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:42.036243 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-846304a0-5688-40ad-b9b2-4f4c13fe13a3 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:42.043751 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-846304a0-5688-40ad-b9b2-4f4c13fe13a3 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1447 microversion: 2.1 time: 0.152162 Dec 20 03:37:42.044317 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 561/1111] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:41 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1447 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:37:42.388348 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-927d42dd-a8c8-4f17-afb8-ab5da49ed40a tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:42.389388 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-927d42dd-a8c8-4f17-afb8-ab5da49ed40a tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:42.396415 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-927d42dd-a8c8-4f17-afb8-ab5da49ed40a tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:42.396925 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-927d42dd-a8c8-4f17-afb8-ab5da49ed40a tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:42.397748 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-927d42dd-a8c8-4f17-afb8-ab5da49ed40a tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:42.398191 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-927d42dd-a8c8-4f17-afb8-ab5da49ed40a tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:42.473986 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-927d42dd-a8c8-4f17-afb8-ab5da49ed40a tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:42.483279 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-927d42dd-a8c8-4f17-afb8-ab5da49ed40a tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1200 microversion: 2.1 time: 0.098894 Dec 20 03:37:42.492665 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 551/1112] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:42 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1200 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:42.955974 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0db1e37d-3c83-4d54-9156-94d04942a300 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:42.956806 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-0db1e37d-3c83-4d54-9156-94d04942a300 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:42.963628 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0db1e37d-3c83-4d54-9156-94d04942a300 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:42.964081 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0db1e37d-3c83-4d54-9156-94d04942a300 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:42.964859 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0db1e37d-3c83-4d54-9156-94d04942a300 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:42.965406 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0db1e37d-3c83-4d54-9156-94d04942a300 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:43.062274 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-13df9699-ffda-42f0-b72c-2b38ee1687fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:43.062873 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-13df9699-ffda-42f0-b72c-2b38ee1687fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:43.070144 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-13df9699-ffda-42f0-b72c-2b38ee1687fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:43.071201 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-0db1e37d-3c83-4d54-9156-94d04942a300 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 200 len: 38404 microversion: 2.20 time: 0.117903 Dec 20 03:37:43.072655 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 562/1113] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:42 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 38404 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:43.073457 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-13df9699-ffda-42f0-b72c-2b38ee1687fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:43.074072 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-13df9699-ffda-42f0-b72c-2b38ee1687fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:43.074768 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-13df9699-ffda-42f0-b72c-2b38ee1687fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:43.082225 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-42c495d6-d300-413e-9134-013ad332edee tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:43.082830 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-42c495d6-d300-413e-9134-013ad332edee tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:43.090054 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-42c495d6-d300-413e-9134-013ad332edee tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:43.090808 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-42c495d6-d300-413e-9134-013ad332edee tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:43.091648 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-42c495d6-d300-413e-9134-013ad332edee tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:43.092207 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-42c495d6-d300-413e-9134-013ad332edee tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:43.118248 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-42c495d6-d300-413e-9134-013ad332edee tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/ips" status: 200 len: 152 microversion: 2.20 time: 0.039526 Dec 20 03:37:43.121809 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 563/1114] 10.222.0.53 () {60 vars in 1288 bytes} [Mon Dec 20 03:37:43 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 03:37:43.499916 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-55726d72-e54c-45e8-888f-3a727c8e6c46 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:43.503307 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-55726d72-e54c-45e8-888f-3a727c8e6c46 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:43.506843 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-55726d72-e54c-45e8-888f-3a727c8e6c46 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:43.507290 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-55726d72-e54c-45e8-888f-3a727c8e6c46 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:43.508638 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-55726d72-e54c-45e8-888f-3a727c8e6c46 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:43.509235 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-55726d72-e54c-45e8-888f-3a727c8e6c46 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:43.573164 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-55726d72-e54c-45e8-888f-3a727c8e6c46 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:43.580568 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-55726d72-e54c-45e8-888f-3a727c8e6c46 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1210 microversion: 2.1 time: 0.084574 Dec 20 03:37:43.581160 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 564/1115] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:43 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:37:43.654408 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-13df9699-ffda-42f0-b72c-2b38ee1687fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:43.678389 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-13df9699-ffda-42f0-b72c-2b38ee1687fa tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1447 microversion: 2.1 time: 0.620169 Dec 20 03:37:43.681675 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 552/1116] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:43 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1447 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:37:43.894952 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-39627725-751e-4b6a-8860-4a1209229a51 req-086cfc3a-5f69-474d-a692-1434bd2124a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc84db6-8d02-4fd4-b38c-c0a90f104993", "name": "network-vif-deleted", "tag": "dcafb0f8-ea15-4cf6-ace1-0817393056e3"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:43.896808 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:37:43.896808 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:37:43.907480 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-39627725-751e-4b6a-8860-4a1209229a51 req-086cfc3a-5f69-474d-a692-1434bd2124a7 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:43.907771 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-39627725-751e-4b6a-8860-4a1209229a51 req-086cfc3a-5f69-474d-a692-1434bd2124a7 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:43.920836 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-39627725-751e-4b6a-8860-4a1209229a51 req-086cfc3a-5f69-474d-a692-1434bd2124a7 service nova] Creating event network-vif-deleted:dcafb0f8-ea15-4cf6-ace1-0817393056e3 for instance 3cc84db6-8d02-4fd4-b38c-c0a90f104993 on hv-cinder-81803 Dec 20 03:37:43.926396 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-39627725-751e-4b6a-8860-4a1209229a51 req-086cfc3a-5f69-474d-a692-1434bd2124a7 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035477 Dec 20 03:37:43.927732 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 565/1117] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:37:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:37:44.597973 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-5b95833a-33dc-4886-a1cf-46802401214b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:44.598578 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-5b95833a-33dc-4886-a1cf-46802401214b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:44.606004 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5b95833a-33dc-4886-a1cf-46802401214b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:44.606457 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5b95833a-33dc-4886-a1cf-46802401214b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:44.611190 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5b95833a-33dc-4886-a1cf-46802401214b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:44.611190 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-5b95833a-33dc-4886-a1cf-46802401214b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:44.699158 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0181034b-18a7-49e6-b7ee-a883f544f442 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:44.700081 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-0181034b-18a7-49e6-b7ee-a883f544f442 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:44.706896 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0181034b-18a7-49e6-b7ee-a883f544f442 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:44.707373 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0181034b-18a7-49e6-b7ee-a883f544f442 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:44.708179 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0181034b-18a7-49e6-b7ee-a883f544f442 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:44.708638 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0181034b-18a7-49e6-b7ee-a883f544f442 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:44.813478 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-0181034b-18a7-49e6-b7ee-a883f544f442 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:44.813478 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-0181034b-18a7-49e6-b7ee-a883f544f442 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1219 microversion: 2.1 time: 0.117712 Dec 20 03:37:44.813478 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 566/1118] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:44 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:37:44.886833 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-5b95833a-33dc-4886-a1cf-46802401214b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:44.895683 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-5b95833a-33dc-4886-a1cf-46802401214b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1266 microversion: 2.1 time: 0.301297 Dec 20 03:37:44.896583 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 553/1119] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:44 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:45.600572 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0caaa6ac-169e-4512-aabe-5af2c6a1d79b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:45.601105 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-0caaa6ac-169e-4512-aabe-5af2c6a1d79b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:45.608465 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0caaa6ac-169e-4512-aabe-5af2c6a1d79b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:45.608907 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0caaa6ac-169e-4512-aabe-5af2c6a1d79b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:45.609718 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0caaa6ac-169e-4512-aabe-5af2c6a1d79b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:45.610147 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0caaa6ac-169e-4512-aabe-5af2c6a1d79b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:45.636468 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.objects.instance [None req-0caaa6ac-169e-4512-aabe-5af2c6a1d79b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lazy-loading 'flavor' on Instance uuid d7866545-6bb6-419b-8357-857dc5ed59a3 {{(pid=117011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:37:45.834374 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-44645f7c-6c13-449f-912c-6a6e50482db1 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:45.834998 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-44645f7c-6c13-449f-912c-6a6e50482db1 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:45.843794 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-44645f7c-6c13-449f-912c-6a6e50482db1 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:45.844278 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-44645f7c-6c13-449f-912c-6a6e50482db1 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:45.845086 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-44645f7c-6c13-449f-912c-6a6e50482db1 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:45.845550 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-44645f7c-6c13-449f-912c-6a6e50482db1 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:45.881128 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-44645f7c-6c13-449f-912c-6a6e50482db1 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:45.881634 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-44645f7c-6c13-449f-912c-6a6e50482db1 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:45.882103 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.objects.instance [None req-44645f7c-6c13-449f-912c-6a6e50482db1 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lazy-loading 'fault' on Instance uuid 3cc84db6-8d02-4fd4-b38c-c0a90f104993 {{(pid=117012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:37:45.925326 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-44645f7c-6c13-449f-912c-6a6e50482db1 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646502be90cb4564a1949d26f4922692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7560abef8ef4bc796f5d8caa41351d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:45.933531 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-44645f7c-6c13-449f-912c-6a6e50482db1 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 200 len: 1224 microversion: 2.1 time: 0.102966 Dec 20 03:37:45.934106 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 554/1120] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:45 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:45.938666 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-2635f9f5-9965-40f2-abde-d6808a08f29c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:45.939278 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-2635f9f5-9965-40f2-abde-d6808a08f29c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:45.945935 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2635f9f5-9965-40f2-abde-d6808a08f29c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:45.948919 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2635f9f5-9965-40f2-abde-d6808a08f29c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:45.949767 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2635f9f5-9965-40f2-abde-d6808a08f29c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:45.950216 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-2635f9f5-9965-40f2-abde-d6808a08f29c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:46.120725 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-2635f9f5-9965-40f2-abde-d6808a08f29c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:46.128996 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-2635f9f5-9965-40f2-abde-d6808a08f29c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1266 microversion: 2.1 time: 0.193835 Dec 20 03:37:46.129632 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 555/1121] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:45 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:46.134692 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-dfa2ccbc-4085-4d3d-9437-a078c6a27708 req-b6aea33c-6ec7-4cdb-88c3-cfa6c34d5e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f14bb563-0377-452e-bd8a-a367eaffe2de", "tag": "c3bb1e5e-eba4-4be2-ae44-80c4d75e395c"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:46.136260 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:37:46.136260 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:37:46.143907 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-dfa2ccbc-4085-4d3d-9437-a078c6a27708 req-b6aea33c-6ec7-4cdb-88c3-cfa6c34d5e59 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:46.144380 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-dfa2ccbc-4085-4d3d-9437-a078c6a27708 req-b6aea33c-6ec7-4cdb-88c3-cfa6c34d5e59 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:46.157121 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-dfa2ccbc-4085-4d3d-9437-a078c6a27708 req-b6aea33c-6ec7-4cdb-88c3-cfa6c34d5e59 service nova] Creating event network-changed:c3bb1e5e-eba4-4be2-ae44-80c4d75e395c for instance f14bb563-0377-452e-bd8a-a367eaffe2de on hv-cinder-81803 Dec 20 03:37:46.162181 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-dfa2ccbc-4085-4d3d-9437-a078c6a27708 req-b6aea33c-6ec7-4cdb-88c3-cfa6c34d5e59 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031411 Dec 20 03:37:46.162774 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 556/1122] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:37:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:37:46.209535 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-0caaa6ac-169e-4512-aabe-5af2c6a1d79b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 202 len: 0 microversion: 2.20 time: 0.612353 Dec 20 03:37:46.210194 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 567/1123] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:37:45 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:37:46.220696 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-266e89c6-2a0a-4c84-97d6-6d97d4c9447a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:46.221993 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-266e89c6-2a0a-4c84-97d6-6d97d4c9447a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:46.233073 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-266e89c6-2a0a-4c84-97d6-6d97d4c9447a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:46.233916 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-266e89c6-2a0a-4c84-97d6-6d97d4c9447a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:46.235060 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-266e89c6-2a0a-4c84-97d6-6d97d4c9447a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:46.235493 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-266e89c6-2a0a-4c84-97d6-6d97d4c9447a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:46.529817 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-266e89c6-2a0a-4c84-97d6-6d97d4c9447a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:46.540739 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-266e89c6-2a0a-4c84-97d6-6d97d4c9447a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:46.542142 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-266e89c6-2a0a-4c84-97d6-6d97d4c9447a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:46.543341 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-266e89c6-2a0a-4c84-97d6-6d97d4c9447a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1725 microversion: 2.20 time: 0.328246 Dec 20 03:37:46.543986 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 557/1124] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:37:46 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1725 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:37:46.951848 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d5aa5cf4-49aa-4952-8bc9-83a2ad7ddeb4 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:46.952536 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d5aa5cf4-49aa-4952-8bc9-83a2ad7ddeb4 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] [instance: 3cc84db6-8d02-4fd4-b38c-c0a90f104993] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:46.958955 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d5aa5cf4-49aa-4952-8bc9-83a2ad7ddeb4 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:46.959330 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d5aa5cf4-49aa-4952-8bc9-83a2ad7ddeb4 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:46.960119 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d5aa5cf4-49aa-4952-8bc9-83a2ad7ddeb4 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:46.960584 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d5aa5cf4-49aa-4952-8bc9-83a2ad7ddeb4 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:46.974712 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-d5aa5cf4-49aa-4952-8bc9-83a2ad7ddeb4 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] HTTP exception thrown: Instance 3cc84db6-8d02-4fd4-b38c-c0a90f104993 could not be found. Dec 20 03:37:46.975300 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d5aa5cf4-49aa-4952-8bc9-83a2ad7ddeb4 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Returning 404 to user: Instance 3cc84db6-8d02-4fd4-b38c-c0a90f104993 could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:37:46.976124 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d5aa5cf4-49aa-4952-8bc9-83a2ad7ddeb4 tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993" status: 404 len: 111 microversion: 2.1 time: 0.028463 Dec 20 03:37:46.976877 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 568/1125] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:46 2021] GET /compute/v2.1/servers/3cc84db6-8d02-4fd4-b38c-c0a90f104993 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 20 03:37:47.146602 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-31f961ca-c30d-4409-b33f-1cb9c6ba6c2c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:47.147296 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-31f961ca-c30d-4409-b33f-1cb9c6ba6c2c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:47.155458 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-31f961ca-c30d-4409-b33f-1cb9c6ba6c2c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:47.155937 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-31f961ca-c30d-4409-b33f-1cb9c6ba6c2c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:47.156747 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-31f961ca-c30d-4409-b33f-1cb9c6ba6c2c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:47.157225 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-31f961ca-c30d-4409-b33f-1cb9c6ba6c2c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:47.327282 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-31f961ca-c30d-4409-b33f-1cb9c6ba6c2c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:47.334642 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-31f961ca-c30d-4409-b33f-1cb9c6ba6c2c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1266 microversion: 2.1 time: 0.192181 Dec 20 03:37:47.335201 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 558/1126] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:47 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:47.403759 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-28a93b2f-c2d7-4608-b33a-a02bf0f1ebae tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] Calling method '.version_select at 0x7f48fff63790>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:47.490789 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-28a93b2f-c2d7-4608-b33a-a02bf0f1ebae tempest-TestShelveInstance-1970519367 tempest-TestShelveInstance-1970519367-project] 10.222.0.53 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2050041413" status: 202 len: 0 microversion: 2.1 time: 0.090606 Dec 20 03:37:47.491533 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 569/1127] 10.222.0.53 () {58 vars in 1253 bytes} [Mon Dec 20 03:37:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2050041413 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 03:37:47.562101 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-b50208b3-65f1-459e-a945-4e54f8986b77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:47.562728 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-b50208b3-65f1-459e-a945-4e54f8986b77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:47.568779 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b50208b3-65f1-459e-a945-4e54f8986b77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:47.569273 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b50208b3-65f1-459e-a945-4e54f8986b77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:47.570109 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b50208b3-65f1-459e-a945-4e54f8986b77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:47.570929 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b50208b3-65f1-459e-a945-4e54f8986b77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:47.710708 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-b50208b3-65f1-459e-a945-4e54f8986b77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:47.719185 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-b50208b3-65f1-459e-a945-4e54f8986b77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:47.720708 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-b50208b3-65f1-459e-a945-4e54f8986b77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:47.721920 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-b50208b3-65f1-459e-a945-4e54f8986b77 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1725 microversion: 2.20 time: 0.163880 Dec 20 03:37:47.722474 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 559/1128] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:37:47 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:37:48.352775 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-13a7a2bd-2398-4e27-8fe7-57908a6f5d02 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:48.353422 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-13a7a2bd-2398-4e27-8fe7-57908a6f5d02 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:48.359445 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-13a7a2bd-2398-4e27-8fe7-57908a6f5d02 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:48.359978 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-13a7a2bd-2398-4e27-8fe7-57908a6f5d02 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:48.360687 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-13a7a2bd-2398-4e27-8fe7-57908a6f5d02 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:48.361128 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-13a7a2bd-2398-4e27-8fe7-57908a6f5d02 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:48.566349 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-13a7a2bd-2398-4e27-8fe7-57908a6f5d02 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:48.578217 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-13a7a2bd-2398-4e27-8fe7-57908a6f5d02 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1266 microversion: 2.1 time: 0.229506 Dec 20 03:37:48.578852 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 570/1129] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:48 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:48.741381 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-b9a82c1b-dc47-467d-a5e0-dbffeb8cb007 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:48.742696 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-b9a82c1b-dc47-467d-a5e0-dbffeb8cb007 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:48.750071 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b9a82c1b-dc47-467d-a5e0-dbffeb8cb007 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:48.750533 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b9a82c1b-dc47-467d-a5e0-dbffeb8cb007 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:48.751346 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b9a82c1b-dc47-467d-a5e0-dbffeb8cb007 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:48.751791 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-b9a82c1b-dc47-467d-a5e0-dbffeb8cb007 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:48.897084 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-b9a82c1b-dc47-467d-a5e0-dbffeb8cb007 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:48.906371 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-b9a82c1b-dc47-467d-a5e0-dbffeb8cb007 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:48.907898 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-b9a82c1b-dc47-467d-a5e0-dbffeb8cb007 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:48.909108 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-b9a82c1b-dc47-467d-a5e0-dbffeb8cb007 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1725 microversion: 2.20 time: 0.172174 Dec 20 03:37:48.909731 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 560/1130] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:37:48 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:37:49.598176 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f01d0ff0-e33c-412a-a4c6-57efd31c1223 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:49.600202 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-f01d0ff0-e33c-412a-a4c6-57efd31c1223 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:49.610655 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f01d0ff0-e33c-412a-a4c6-57efd31c1223 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:49.611375 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f01d0ff0-e33c-412a-a4c6-57efd31c1223 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:49.612479 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f01d0ff0-e33c-412a-a4c6-57efd31c1223 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:49.613126 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f01d0ff0-e33c-412a-a4c6-57efd31c1223 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:49.783394 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-f01d0ff0-e33c-412a-a4c6-57efd31c1223 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:49.792941 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f01d0ff0-e33c-412a-a4c6-57efd31c1223 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1266 microversion: 2.1 time: 0.200012 Dec 20 03:37:49.803113 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 571/1131] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:49 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:49.928892 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-72cbf85d-af34-464f-b692-7f498b9babfd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:49.929493 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-72cbf85d-af34-464f-b692-7f498b9babfd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:49.936315 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-72cbf85d-af34-464f-b692-7f498b9babfd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:49.937176 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-72cbf85d-af34-464f-b692-7f498b9babfd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:49.938351 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-72cbf85d-af34-464f-b692-7f498b9babfd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:49.938966 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-72cbf85d-af34-464f-b692-7f498b9babfd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:50.108674 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-72cbf85d-af34-464f-b692-7f498b9babfd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:50.118625 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-72cbf85d-af34-464f-b692-7f498b9babfd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:50.120500 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-72cbf85d-af34-464f-b692-7f498b9babfd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:50.121979 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-72cbf85d-af34-464f-b692-7f498b9babfd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1725 microversion: 2.20 time: 0.197310 Dec 20 03:37:50.122542 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 561/1132] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:37:49 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:37:50.809685 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-9dd423ca-957d-4bfb-9a2a-aaba32374731 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:50.810270 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-9dd423ca-957d-4bfb-9a2a-aaba32374731 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:50.816649 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9dd423ca-957d-4bfb-9a2a-aaba32374731 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:50.819147 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9dd423ca-957d-4bfb-9a2a-aaba32374731 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:50.819147 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9dd423ca-957d-4bfb-9a2a-aaba32374731 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:50.819147 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9dd423ca-957d-4bfb-9a2a-aaba32374731 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:51.001519 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9dd423ca-957d-4bfb-9a2a-aaba32374731 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:51.010742 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-9dd423ca-957d-4bfb-9a2a-aaba32374731 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1266 microversion: 2.1 time: 0.204563 Dec 20 03:37:51.011329 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 572/1133] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:50 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:51.142335 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-35fa92b9-6870-486d-88f0-aa796d0a63d0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:51.143007 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-35fa92b9-6870-486d-88f0-aa796d0a63d0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:51.149935 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-35fa92b9-6870-486d-88f0-aa796d0a63d0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:51.150694 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-35fa92b9-6870-486d-88f0-aa796d0a63d0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:51.151507 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-35fa92b9-6870-486d-88f0-aa796d0a63d0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:51.151955 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-35fa92b9-6870-486d-88f0-aa796d0a63d0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:51.331139 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-35fa92b9-6870-486d-88f0-aa796d0a63d0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:51.339213 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-35fa92b9-6870-486d-88f0-aa796d0a63d0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:51.340709 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-35fa92b9-6870-486d-88f0-aa796d0a63d0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:51.341906 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-35fa92b9-6870-486d-88f0-aa796d0a63d0 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1725 microversion: 2.20 time: 0.203696 Dec 20 03:37:51.342447 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 562/1134] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:37:51 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:37:52.028236 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1c84d9fc-a32c-4d1f-86d3-01b34face68b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:52.029097 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1c84d9fc-a32c-4d1f-86d3-01b34face68b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:52.035393 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1c84d9fc-a32c-4d1f-86d3-01b34face68b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:52.035838 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1c84d9fc-a32c-4d1f-86d3-01b34face68b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:52.036647 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1c84d9fc-a32c-4d1f-86d3-01b34face68b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:52.037056 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1c84d9fc-a32c-4d1f-86d3-01b34face68b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:52.279850 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-1c84d9fc-a32c-4d1f-86d3-01b34face68b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:52.287372 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1c84d9fc-a32c-4d1f-86d3-01b34face68b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1266 microversion: 2.1 time: 0.262817 Dec 20 03:37:52.287979 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 573/1135] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:52 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:52.359321 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-27b9b7b4-9d8f-4f6a-a001-59a68f47bbfd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:52.359926 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-27b9b7b4-9d8f-4f6a-a001-59a68f47bbfd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:52.367317 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-27b9b7b4-9d8f-4f6a-a001-59a68f47bbfd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:52.368025 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-27b9b7b4-9d8f-4f6a-a001-59a68f47bbfd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:52.368471 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-27b9b7b4-9d8f-4f6a-a001-59a68f47bbfd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:52.369426 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-27b9b7b4-9d8f-4f6a-a001-59a68f47bbfd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:52.508472 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-27b9b7b4-9d8f-4f6a-a001-59a68f47bbfd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:52.516890 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-27b9b7b4-9d8f-4f6a-a001-59a68f47bbfd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:52.518446 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-27b9b7b4-9d8f-4f6a-a001-59a68f47bbfd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:52.519613 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-27b9b7b4-9d8f-4f6a-a001-59a68f47bbfd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1725 microversion: 2.20 time: 0.164049 Dec 20 03:37:52.520364 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 563/1136] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:37:52 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:37:53.306039 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-c41d290f-ee9d-461e-8f3d-b1556a6e2f0c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:53.306656 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-c41d290f-ee9d-461e-8f3d-b1556a6e2f0c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:53.313072 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c41d290f-ee9d-461e-8f3d-b1556a6e2f0c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:53.313560 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c41d290f-ee9d-461e-8f3d-b1556a6e2f0c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:53.314402 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c41d290f-ee9d-461e-8f3d-b1556a6e2f0c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:53.314844 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-c41d290f-ee9d-461e-8f3d-b1556a6e2f0c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:53.539672 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-62619c1f-7dfc-4d9e-8e6f-c1a76e6443ec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:53.540460 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-62619c1f-7dfc-4d9e-8e6f-c1a76e6443ec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:53.550604 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-62619c1f-7dfc-4d9e-8e6f-c1a76e6443ec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:53.550604 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-62619c1f-7dfc-4d9e-8e6f-c1a76e6443ec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:53.550933 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-c41d290f-ee9d-461e-8f3d-b1556a6e2f0c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:53.551069 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-62619c1f-7dfc-4d9e-8e6f-c1a76e6443ec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:53.551069 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-62619c1f-7dfc-4d9e-8e6f-c1a76e6443ec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:53.556329 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-c41d290f-ee9d-461e-8f3d-b1556a6e2f0c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1266 microversion: 2.1 time: 0.255012 Dec 20 03:37:53.556996 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 574/1137] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:53 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:53.710978 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-62619c1f-7dfc-4d9e-8e6f-c1a76e6443ec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:53.724660 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-62619c1f-7dfc-4d9e-8e6f-c1a76e6443ec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:53.727396 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-62619c1f-7dfc-4d9e-8e6f-c1a76e6443ec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:53.730024 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-62619c1f-7dfc-4d9e-8e6f-c1a76e6443ec tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1725 microversion: 2.20 time: 0.194603 Dec 20 03:37:53.731039 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 564/1138] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:37:53 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:37:54.574885 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1bf87dfd-bd46-40aa-be66-7bdeea622bab tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:54.575978 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1bf87dfd-bd46-40aa-be66-7bdeea622bab tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:54.584742 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1bf87dfd-bd46-40aa-be66-7bdeea622bab tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:54.585369 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1bf87dfd-bd46-40aa-be66-7bdeea622bab tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:54.586938 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1bf87dfd-bd46-40aa-be66-7bdeea622bab tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:54.587445 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1bf87dfd-bd46-40aa-be66-7bdeea622bab tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:54.762798 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-50a9cc51-7972-47cf-b91b-bbd771b9815d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:54.763717 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-50a9cc51-7972-47cf-b91b-bbd771b9815d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:54.785697 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-50a9cc51-7972-47cf-b91b-bbd771b9815d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:54.791289 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-50a9cc51-7972-47cf-b91b-bbd771b9815d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:54.795264 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-50a9cc51-7972-47cf-b91b-bbd771b9815d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:54.796513 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-50a9cc51-7972-47cf-b91b-bbd771b9815d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:54.825440 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-1bf87dfd-bd46-40aa-be66-7bdeea622bab tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:54.845343 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1bf87dfd-bd46-40aa-be66-7bdeea622bab tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1266 microversion: 2.1 time: 0.275301 Dec 20 03:37:54.846315 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 575/1139] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:54 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:55.094872 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-50a9cc51-7972-47cf-b91b-bbd771b9815d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:55.115163 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-50a9cc51-7972-47cf-b91b-bbd771b9815d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:55.118847 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-50a9cc51-7972-47cf-b91b-bbd771b9815d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:55.120947 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-50a9cc51-7972-47cf-b91b-bbd771b9815d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1725 microversion: 2.20 time: 0.363744 Dec 20 03:37:55.127741 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 565/1140] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:37:54 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1725 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:37:55.866154 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-4a8379da-da50-4570-ae6d-41138072ac53 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:55.867034 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-4a8379da-da50-4570-ae6d-41138072ac53 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:55.879117 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4a8379da-da50-4570-ae6d-41138072ac53 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:55.879565 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4a8379da-da50-4570-ae6d-41138072ac53 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:55.880382 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4a8379da-da50-4570-ae6d-41138072ac53 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:55.880907 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4a8379da-da50-4570-ae6d-41138072ac53 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:56.034915 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-4a8379da-da50-4570-ae6d-41138072ac53 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:56.043017 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-4a8379da-da50-4570-ae6d-41138072ac53 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1266 microversion: 2.1 time: 0.182679 Dec 20 03:37:56.043593 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 576/1141] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:55 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:56.140263 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1bc57651-9ad3-4655-bca1-06da582a3cad tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:56.140774 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1bc57651-9ad3-4655-bca1-06da582a3cad tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:56.147593 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1bc57651-9ad3-4655-bca1-06da582a3cad tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:56.148712 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1bc57651-9ad3-4655-bca1-06da582a3cad tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:56.149966 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1bc57651-9ad3-4655-bca1-06da582a3cad tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:56.150412 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1bc57651-9ad3-4655-bca1-06da582a3cad tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:56.153447 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-9492e9f4-0556-4e63-af77-58db37306c85 req-4a46c62e-8306-4ea4-ab57-19e7372ffd71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f14bb563-0377-452e-bd8a-a367eaffe2de", "name": "network-vif-plugged", "status": "completed", "tag": "c3bb1e5e-eba4-4be2-ae44-80c4d75e395c"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:37:56.155399 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:37:56.155399 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:37:56.163808 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-9492e9f4-0556-4e63-af77-58db37306c85 req-4a46c62e-8306-4ea4-ab57-19e7372ffd71 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:56.164257 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-9492e9f4-0556-4e63-af77-58db37306c85 req-4a46c62e-8306-4ea4-ab57-19e7372ffd71 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:56.177799 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-9492e9f4-0556-4e63-af77-58db37306c85 req-4a46c62e-8306-4ea4-ab57-19e7372ffd71 service nova] Creating event network-vif-plugged:c3bb1e5e-eba4-4be2-ae44-80c4d75e395c for instance f14bb563-0377-452e-bd8a-a367eaffe2de on hv-cinder-81803 Dec 20 03:37:56.183459 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-9492e9f4-0556-4e63-af77-58db37306c85 req-4a46c62e-8306-4ea4-ab57-19e7372ffd71 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033730 Dec 20 03:37:56.184067 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 577/1142] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:37:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:37:56.336199 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1bc57651-9ad3-4655-bca1-06da582a3cad tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:56.350196 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1bc57651-9ad3-4655-bca1-06da582a3cad tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:56.353104 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1bc57651-9ad3-4655-bca1-06da582a3cad tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:56.355891 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1bc57651-9ad3-4655-bca1-06da582a3cad tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1725 microversion: 2.20 time: 0.219434 Dec 20 03:37:56.356864 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 566/1143] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:37:56 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:37:57.063656 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d95113bb-7dfb-4081-913a-24d27c37feac tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:57.064381 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d95113bb-7dfb-4081-913a-24d27c37feac tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:57.070918 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d95113bb-7dfb-4081-913a-24d27c37feac tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:57.071377 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d95113bb-7dfb-4081-913a-24d27c37feac tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:57.072177 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d95113bb-7dfb-4081-913a-24d27c37feac tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:57.072624 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d95113bb-7dfb-4081-913a-24d27c37feac tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:57.229866 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d95113bb-7dfb-4081-913a-24d27c37feac tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:57.237398 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d95113bb-7dfb-4081-913a-24d27c37feac tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1266 microversion: 2.1 time: 0.178187 Dec 20 03:37:57.239609 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 578/1144] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:57 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:57.376064 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-279747ee-5ca2-443a-91db-9c73195c6b32 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:57.376820 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-279747ee-5ca2-443a-91db-9c73195c6b32 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:57.383958 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-279747ee-5ca2-443a-91db-9c73195c6b32 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:57.384412 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-279747ee-5ca2-443a-91db-9c73195c6b32 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:57.385224 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-279747ee-5ca2-443a-91db-9c73195c6b32 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:57.386076 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-279747ee-5ca2-443a-91db-9c73195c6b32 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:57.530675 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-279747ee-5ca2-443a-91db-9c73195c6b32 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:57.539696 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-279747ee-5ca2-443a-91db-9c73195c6b32 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:57.541392 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-279747ee-5ca2-443a-91db-9c73195c6b32 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:57.542612 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-279747ee-5ca2-443a-91db-9c73195c6b32 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1746 microversion: 2.20 time: 0.170746 Dec 20 03:37:57.543179 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 567/1145] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:37:57 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:37:58.255945 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f60a045e-08b6-4410-aaf2-454b34843d0c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:58.256724 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-f60a045e-08b6-4410-aaf2-454b34843d0c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:58.264023 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f60a045e-08b6-4410-aaf2-454b34843d0c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:58.264477 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f60a045e-08b6-4410-aaf2-454b34843d0c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:58.265400 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f60a045e-08b6-4410-aaf2-454b34843d0c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:58.265806 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f60a045e-08b6-4410-aaf2-454b34843d0c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:58.402706 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-f60a045e-08b6-4410-aaf2-454b34843d0c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:58.410298 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f60a045e-08b6-4410-aaf2-454b34843d0c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1453 microversion: 2.1 time: 0.158784 Dec 20 03:37:58.410871 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 579/1146] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:58 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:58.425937 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ddd3668d-4c58-4149-87c7-f57038d57335 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:58.426721 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ddd3668d-4c58-4149-87c7-f57038d57335 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:58.433859 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ddd3668d-4c58-4149-87c7-f57038d57335 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:58.434310 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ddd3668d-4c58-4149-87c7-f57038d57335 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:58.435109 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ddd3668d-4c58-4149-87c7-f57038d57335 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:58.435554 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ddd3668d-4c58-4149-87c7-f57038d57335 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:58.568009 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b2c17444-a78a-4753-b0c9-8cd2b3521264 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:58.569180 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-b2c17444-a78a-4753-b0c9-8cd2b3521264 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:58.579911 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b2c17444-a78a-4753-b0c9-8cd2b3521264 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:58.580719 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b2c17444-a78a-4753-b0c9-8cd2b3521264 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:58.582197 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b2c17444-a78a-4753-b0c9-8cd2b3521264 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:58.583000 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b2c17444-a78a-4753-b0c9-8cd2b3521264 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:58.617372 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-ddd3668d-4c58-4149-87c7-f57038d57335 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:58.629080 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ddd3668d-4c58-4149-87c7-f57038d57335 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1453 microversion: 2.1 time: 0.206609 Dec 20 03:37:58.629796 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 568/1147] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:37:58 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1453 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:37:58.736297 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b2c17444-a78a-4753-b0c9-8cd2b3521264 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:58.745783 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b2c17444-a78a-4753-b0c9-8cd2b3521264 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:58.747296 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b2c17444-a78a-4753-b0c9-8cd2b3521264 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:37:58.748501 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b2c17444-a78a-4753-b0c9-8cd2b3521264 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1746 microversion: 2.20 time: 0.187786 Dec 20 03:37:58.749065 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 580/1148] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:37:58 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1746 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:37:59.771439 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-369af95a-aade-485e-b527-696268ce03e2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:37:59.772765 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-369af95a-aade-485e-b527-696268ce03e2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:37:59.795545 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-369af95a-aade-485e-b527-696268ce03e2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:59.795545 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-369af95a-aade-485e-b527-696268ce03e2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:37:59.795912 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-369af95a-aade-485e-b527-696268ce03e2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:37:59.798078 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-369af95a-aade-485e-b527-696268ce03e2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:00.087196 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-369af95a-aade-485e-b527-696268ce03e2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:00.097842 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-369af95a-aade-485e-b527-696268ce03e2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:00.099565 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-369af95a-aade-485e-b527-696268ce03e2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:00.103134 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-369af95a-aade-485e-b527-696268ce03e2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1741 microversion: 2.20 time: 0.338336 Dec 20 03:38:00.107050 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 569/1149] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:37:59 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1741 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:01.132957 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-33ea738a-6a8b-401c-bc2f-f657477c144c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:01.135093 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-33ea738a-6a8b-401c-bc2f-f657477c144c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:01.145653 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-33ea738a-6a8b-401c-bc2f-f657477c144c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:01.146485 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-33ea738a-6a8b-401c-bc2f-f657477c144c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:01.147457 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-33ea738a-6a8b-401c-bc2f-f657477c144c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:01.148676 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-33ea738a-6a8b-401c-bc2f-f657477c144c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:01.430029 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-33ea738a-6a8b-401c-bc2f-f657477c144c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:01.443096 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-33ea738a-6a8b-401c-bc2f-f657477c144c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:01.452791 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-33ea738a-6a8b-401c-bc2f-f657477c144c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:01.458614 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-33ea738a-6a8b-401c-bc2f-f657477c144c tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1741 microversion: 2.20 time: 0.332939 Dec 20 03:38:01.462943 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 581/1150] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:01 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1741 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:01.503122 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-6d2a7e85-7c78-446b-92ab-0a2c0a92eea9 req-b42d3a82-f053-49f5-9b0c-fae241d1b873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f14bb563-0377-452e-bd8a-a367eaffe2de", "tag": "c3bb1e5e-eba4-4be2-ae44-80c4d75e395c"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:38:01.505796 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:38:01.505796 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:38:01.515299 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-6d2a7e85-7c78-446b-92ab-0a2c0a92eea9 req-b42d3a82-f053-49f5-9b0c-fae241d1b873 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:01.518845 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-6d2a7e85-7c78-446b-92ab-0a2c0a92eea9 req-b42d3a82-f053-49f5-9b0c-fae241d1b873 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:01.529911 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-6d2a7e85-7c78-446b-92ab-0a2c0a92eea9 req-b42d3a82-f053-49f5-9b0c-fae241d1b873 service nova] Creating event network-changed:c3bb1e5e-eba4-4be2-ae44-80c4d75e395c for instance f14bb563-0377-452e-bd8a-a367eaffe2de on hv-cinder-81803 Dec 20 03:38:01.537518 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-6d2a7e85-7c78-446b-92ab-0a2c0a92eea9 req-b42d3a82-f053-49f5-9b0c-fae241d1b873 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038277 Dec 20 03:38:01.539250 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 570/1151] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:38:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:38:02.481681 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-2dabc1f6-4319-478f-b828-c71cfab63ce2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:02.485378 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-2dabc1f6-4319-478f-b828-c71cfab63ce2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:02.494796 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2dabc1f6-4319-478f-b828-c71cfab63ce2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:02.495683 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2dabc1f6-4319-478f-b828-c71cfab63ce2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:02.496878 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2dabc1f6-4319-478f-b828-c71cfab63ce2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:02.498079 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2dabc1f6-4319-478f-b828-c71cfab63ce2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:02.605267 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-3730ffaf-5abf-484e-8cc8-d8a4d8a8003b req-3befe59c-6fbb-4ef1-9b91-5f614cdd3d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7866545-6bb6-419b-8357-857dc5ed59a3", "name": "network-vif-plugged", "status": "completed", "tag": "aa42babd-fe16-4436-b001-648058d3d1ee"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:38:02.607604 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:38:02.607604 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:38:02.624173 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-3730ffaf-5abf-484e-8cc8-d8a4d8a8003b req-3befe59c-6fbb-4ef1-9b91-5f614cdd3d01 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:02.625539 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-3730ffaf-5abf-484e-8cc8-d8a4d8a8003b req-3befe59c-6fbb-4ef1-9b91-5f614cdd3d01 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:02.659746 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-3730ffaf-5abf-484e-8cc8-d8a4d8a8003b req-3befe59c-6fbb-4ef1-9b91-5f614cdd3d01 service nova] Creating event network-vif-plugged:aa42babd-fe16-4436-b001-648058d3d1ee for instance d7866545-6bb6-419b-8357-857dc5ed59a3 on hv-cinder-81803 Dec 20 03:38:02.673286 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-3730ffaf-5abf-484e-8cc8-d8a4d8a8003b req-3befe59c-6fbb-4ef1-9b91-5f614cdd3d01 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073004 Dec 20 03:38:02.674491 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 571/1152] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:38:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:38:02.752804 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-2dabc1f6-4319-478f-b828-c71cfab63ce2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:02.764587 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-2dabc1f6-4319-478f-b828-c71cfab63ce2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:02.766650 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-2dabc1f6-4319-478f-b828-c71cfab63ce2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:02.768011 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-2dabc1f6-4319-478f-b828-c71cfab63ce2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1741 microversion: 2.20 time: 0.291676 Dec 20 03:38:02.768673 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 582/1153] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:02 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1741 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:03.787194 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7d60667a-0253-4580-9701-d8f05b3d089f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:03.787886 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-7d60667a-0253-4580-9701-d8f05b3d089f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:03.795115 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7d60667a-0253-4580-9701-d8f05b3d089f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:03.795563 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7d60667a-0253-4580-9701-d8f05b3d089f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:03.796364 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7d60667a-0253-4580-9701-d8f05b3d089f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:03.796803 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7d60667a-0253-4580-9701-d8f05b3d089f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:03.937386 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7d60667a-0253-4580-9701-d8f05b3d089f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:03.946698 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7d60667a-0253-4580-9701-d8f05b3d089f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:03.948402 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7d60667a-0253-4580-9701-d8f05b3d089f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:03.949729 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7d60667a-0253-4580-9701-d8f05b3d089f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1741 microversion: 2.20 time: 0.167059 Dec 20 03:38:03.950381 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 572/1154] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:03 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:38:04.969775 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-72c04165-8b18-45e8-9351-06c190843719 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:04.970401 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-72c04165-8b18-45e8-9351-06c190843719 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:04.978219 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-72c04165-8b18-45e8-9351-06c190843719 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:04.978789 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-72c04165-8b18-45e8-9351-06c190843719 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:04.980048 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-72c04165-8b18-45e8-9351-06c190843719 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:04.980590 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-72c04165-8b18-45e8-9351-06c190843719 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:05.156975 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-72c04165-8b18-45e8-9351-06c190843719 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:05.169231 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-72c04165-8b18-45e8-9351-06c190843719 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:05.170746 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-72c04165-8b18-45e8-9351-06c190843719 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:05.171934 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-72c04165-8b18-45e8-9351-06c190843719 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1741 microversion: 2.20 time: 0.206419 Dec 20 03:38:05.172561 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 583/1155] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:04 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1741 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:06.191563 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d193b580-03ba-4774-8f82-344542d31cf2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:06.192161 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d193b580-03ba-4774-8f82-344542d31cf2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:06.198669 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d193b580-03ba-4774-8f82-344542d31cf2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:06.199116 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d193b580-03ba-4774-8f82-344542d31cf2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:06.199905 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d193b580-03ba-4774-8f82-344542d31cf2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:06.200339 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d193b580-03ba-4774-8f82-344542d31cf2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:06.374037 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d193b580-03ba-4774-8f82-344542d31cf2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:06.382704 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d193b580-03ba-4774-8f82-344542d31cf2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:06.384361 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d193b580-03ba-4774-8f82-344542d31cf2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:06.385577 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d193b580-03ba-4774-8f82-344542d31cf2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1741 microversion: 2.20 time: 0.197832 Dec 20 03:38:06.386152 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 573/1156] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:06 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1741 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:07.406219 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-87ac2443-8c5a-4c8e-92b6-39f3be8cb266 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:07.406859 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-87ac2443-8c5a-4c8e-92b6-39f3be8cb266 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:07.413832 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-87ac2443-8c5a-4c8e-92b6-39f3be8cb266 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:07.414273 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-87ac2443-8c5a-4c8e-92b6-39f3be8cb266 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:07.415053 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-87ac2443-8c5a-4c8e-92b6-39f3be8cb266 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:07.415477 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-87ac2443-8c5a-4c8e-92b6-39f3be8cb266 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:07.560906 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-87ac2443-8c5a-4c8e-92b6-39f3be8cb266 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:07.569071 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-87ac2443-8c5a-4c8e-92b6-39f3be8cb266 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:07.570812 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-87ac2443-8c5a-4c8e-92b6-39f3be8cb266 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:07.572045 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-87ac2443-8c5a-4c8e-92b6-39f3be8cb266 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1741 microversion: 2.20 time: 0.169538 Dec 20 03:38:07.572869 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 584/1157] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:07 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:08.595350 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d2327e4e-4a3a-4470-8ba0-e1900c0b53c8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:08.596033 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d2327e4e-4a3a-4470-8ba0-e1900c0b53c8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:08.604443 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d2327e4e-4a3a-4470-8ba0-e1900c0b53c8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:08.605206 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d2327e4e-4a3a-4470-8ba0-e1900c0b53c8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:08.606433 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d2327e4e-4a3a-4470-8ba0-e1900c0b53c8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:08.606873 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d2327e4e-4a3a-4470-8ba0-e1900c0b53c8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:08.789881 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d2327e4e-4a3a-4470-8ba0-e1900c0b53c8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:08.813753 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d2327e4e-4a3a-4470-8ba0-e1900c0b53c8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:08.816050 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d2327e4e-4a3a-4470-8ba0-e1900c0b53c8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:08.817949 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d2327e4e-4a3a-4470-8ba0-e1900c0b53c8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1741 microversion: 2.20 time: 0.228897 Dec 20 03:38:08.830909 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 574/1158] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:08 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1741 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:09.842303 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-7492a232-d323-4d9d-88ac-b9803e2f22f9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:09.842919 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-7492a232-d323-4d9d-88ac-b9803e2f22f9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:09.849766 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7492a232-d323-4d9d-88ac-b9803e2f22f9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:09.850217 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7492a232-d323-4d9d-88ac-b9803e2f22f9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:09.851973 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7492a232-d323-4d9d-88ac-b9803e2f22f9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:09.852535 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7492a232-d323-4d9d-88ac-b9803e2f22f9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:10.061462 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-7492a232-d323-4d9d-88ac-b9803e2f22f9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:10.074134 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-7492a232-d323-4d9d-88ac-b9803e2f22f9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:10.075882 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-7492a232-d323-4d9d-88ac-b9803e2f22f9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:10.077116 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-7492a232-d323-4d9d-88ac-b9803e2f22f9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1741 microversion: 2.20 time: 0.239155 Dec 20 03:38:10.085315 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 585/1159] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:09 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1741 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:11.102246 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a732e080-a7e6-4aff-8e68-30c24dc908df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:11.103244 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a732e080-a7e6-4aff-8e68-30c24dc908df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:11.111403 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a732e080-a7e6-4aff-8e68-30c24dc908df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:11.111857 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a732e080-a7e6-4aff-8e68-30c24dc908df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:11.112655 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a732e080-a7e6-4aff-8e68-30c24dc908df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:11.113099 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a732e080-a7e6-4aff-8e68-30c24dc908df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:11.310616 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-a732e080-a7e6-4aff-8e68-30c24dc908df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:11.319943 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-a732e080-a7e6-4aff-8e68-30c24dc908df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:11.321643 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-a732e080-a7e6-4aff-8e68-30c24dc908df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:11.322940 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a732e080-a7e6-4aff-8e68-30c24dc908df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1741 microversion: 2.20 time: 0.229817 Dec 20 03:38:11.323958 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 575/1160] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:11 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1741 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:38:12.341524 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-8f29f233-f065-4923-8378-84bd45bb7759 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:12.342400 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-8f29f233-f065-4923-8378-84bd45bb7759 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:12.348754 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8f29f233-f065-4923-8378-84bd45bb7759 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:12.349223 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8f29f233-f065-4923-8378-84bd45bb7759 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:12.350011 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8f29f233-f065-4923-8378-84bd45bb7759 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:12.350651 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-8f29f233-f065-4923-8378-84bd45bb7759 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:12.506847 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-8f29f233-f065-4923-8378-84bd45bb7759 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:12.515636 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-8f29f233-f065-4923-8378-84bd45bb7759 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:12.517197 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-8f29f233-f065-4923-8378-84bd45bb7759 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:12.518428 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-8f29f233-f065-4923-8378-84bd45bb7759 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1741 microversion: 2.20 time: 0.180754 Dec 20 03:38:12.519011 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 586/1161] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:12 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:13.536807 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c35fc1a9-b601-48ee-aafa-d2520114ace4 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:13.537393 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c35fc1a9-b601-48ee-aafa-d2520114ace4 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:13.545271 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c35fc1a9-b601-48ee-aafa-d2520114ace4 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:13.545719 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c35fc1a9-b601-48ee-aafa-d2520114ace4 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:13.546508 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c35fc1a9-b601-48ee-aafa-d2520114ace4 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:13.546940 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c35fc1a9-b601-48ee-aafa-d2520114ace4 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:13.693606 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c35fc1a9-b601-48ee-aafa-d2520114ace4 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:13.701766 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c35fc1a9-b601-48ee-aafa-d2520114ace4 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:13.703269 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c35fc1a9-b601-48ee-aafa-d2520114ace4 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:13.704400 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c35fc1a9-b601-48ee-aafa-d2520114ace4 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1723 microversion: 2.20 time: 0.171555 Dec 20 03:38:13.704947 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 576/1162] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:13 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:14.727523 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-fc0e332f-a537-4242-bea4-f44c1a5d6652 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:14.728518 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-fc0e332f-a537-4242-bea4-f44c1a5d6652 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:14.739919 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fc0e332f-a537-4242-bea4-f44c1a5d6652 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:14.740743 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fc0e332f-a537-4242-bea4-f44c1a5d6652 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:14.742249 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fc0e332f-a537-4242-bea4-f44c1a5d6652 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:14.743068 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-fc0e332f-a537-4242-bea4-f44c1a5d6652 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:14.919759 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-fc0e332f-a537-4242-bea4-f44c1a5d6652 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:14.930140 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-fc0e332f-a537-4242-bea4-f44c1a5d6652 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:14.931814 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-fc0e332f-a537-4242-bea4-f44c1a5d6652 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:14.932994 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-fc0e332f-a537-4242-bea4-f44c1a5d6652 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1723 microversion: 2.20 time: 0.213092 Dec 20 03:38:14.933582 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 587/1163] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:14 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:15.952897 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1e24231d-1945-4bbe-83d0-3e8a10b3b11e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:15.953603 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1e24231d-1945-4bbe-83d0-3e8a10b3b11e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:15.960078 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1e24231d-1945-4bbe-83d0-3e8a10b3b11e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:15.960520 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1e24231d-1945-4bbe-83d0-3e8a10b3b11e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:15.961352 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1e24231d-1945-4bbe-83d0-3e8a10b3b11e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:15.961785 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1e24231d-1945-4bbe-83d0-3e8a10b3b11e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:16.138193 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1e24231d-1945-4bbe-83d0-3e8a10b3b11e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:16.146725 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1e24231d-1945-4bbe-83d0-3e8a10b3b11e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:16.148867 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1e24231d-1945-4bbe-83d0-3e8a10b3b11e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:16.150146 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1e24231d-1945-4bbe-83d0-3e8a10b3b11e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1726 microversion: 2.20 time: 0.201885 Dec 20 03:38:16.150720 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 577/1164] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:15 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1726 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:38:16.167903 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e57bb37b-5f85-4952-8405-e560e0e5c137 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ece9754c-b083-40fb-ab98-81a3b7de5b99"}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:38:16.169024 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e57bb37b-5f85-4952-8405-e560e0e5c137 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:16.175350 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-52f77d66-8215-4290-aecd-63fdf60bafc4 req-1f16ad54-ba29-4605-9edf-a9bf22c35597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7866545-6bb6-419b-8357-857dc5ed59a3", "name": "network-vif-unplugged", "status": "completed", "tag": "aa42babd-fe16-4436-b001-648058d3d1ee"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:38:16.175971 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e57bb37b-5f85-4952-8405-e560e0e5c137 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:16.176430 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e57bb37b-5f85-4952-8405-e560e0e5c137 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:16.177367 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e57bb37b-5f85-4952-8405-e560e0e5c137 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:16.177648 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:38:16.177648 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:38:16.178020 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e57bb37b-5f85-4952-8405-e560e0e5c137 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:16.187585 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-52f77d66-8215-4290-aecd-63fdf60bafc4 req-1f16ad54-ba29-4605-9edf-a9bf22c35597 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:16.188044 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-52f77d66-8215-4290-aecd-63fdf60bafc4 req-1f16ad54-ba29-4605-9edf-a9bf22c35597 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:16.201074 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-52f77d66-8215-4290-aecd-63fdf60bafc4 req-1f16ad54-ba29-4605-9edf-a9bf22c35597 service nova] Creating event network-vif-unplugged:aa42babd-fe16-4436-b001-648058d3d1ee for instance d7866545-6bb6-419b-8357-857dc5ed59a3 on hv-cinder-81803 Dec 20 03:38:16.206478 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-52f77d66-8215-4290-aecd-63fdf60bafc4 req-1f16ad54-ba29-4605-9edf-a9bf22c35597 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034646 Dec 20 03:38:16.207421 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 578/1165] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:38:16 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:38:17.195330 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e57bb37b-5f85-4952-8405-e560e0e5c137 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.031262 Dec 20 03:38:17.195952 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 588/1166] 10.222.0.53 () {62 vars in 1363 bytes} [Mon Dec 20 03:38:16 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/os-volume_attachments => generated 188 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 03:38:17.306220 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7a72efc0-b4f7-4cdb-baaf-49fc89d5531d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:17.306801 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-7a72efc0-b4f7-4cdb-baaf-49fc89d5531d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:17.312912 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7a72efc0-b4f7-4cdb-baaf-49fc89d5531d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:17.313406 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7a72efc0-b4f7-4cdb-baaf-49fc89d5531d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:17.314189 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7a72efc0-b4f7-4cdb-baaf-49fc89d5531d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:17.314625 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7a72efc0-b4f7-4cdb-baaf-49fc89d5531d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:18.104883 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7a72efc0-b4f7-4cdb-baaf-49fc89d5531d tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "DELETE /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/os-volume_attachments/ece9754c-b083-40fb-ab98-81a3b7de5b99" status: 202 len: 0 microversion: 2.20 time: 0.803241 Dec 20 03:38:18.105504 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 579/1167] 10.222.0.53 () {60 vars in 1456 bytes} [Mon Dec 20 03:38:17 2021] DELETE /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/os-volume_attachments/ece9754c-b083-40fb-ab98-81a3b7de5b99 => generated 0 bytes in 805 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:38:18.157373 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-bdb8ee49-0400-4b3e-9aa4-d462ad08ef5f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:38:18.157945 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-bdb8ee49-0400-4b3e-9aa4-d462ad08ef5f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:18.164538 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bdb8ee49-0400-4b3e-9aa4-d462ad08ef5f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:18.164990 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bdb8ee49-0400-4b3e-9aa4-d462ad08ef5f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:18.165897 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bdb8ee49-0400-4b3e-9aa4-d462ad08ef5f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:18.166333 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-bdb8ee49-0400-4b3e-9aa4-d462ad08ef5f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:18.382498 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-bdb8ee49-0400-4b3e-9aa4-d462ad08ef5f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action" status: 202 len: 0 microversion: 2.20 time: 0.228670 Dec 20 03:38:18.383414 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 589/1168] 10.222.0.53 () {62 vars in 1318 bytes} [Mon Dec 20 03:38:18 2021] POST /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:38:18.391053 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a351e00e-df98-4d58-b6e5-69314ea030e8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:18.391795 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a351e00e-df98-4d58-b6e5-69314ea030e8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:18.399788 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a351e00e-df98-4d58-b6e5-69314ea030e8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:18.400279 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a351e00e-df98-4d58-b6e5-69314ea030e8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:18.401068 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a351e00e-df98-4d58-b6e5-69314ea030e8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:18.401533 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a351e00e-df98-4d58-b6e5-69314ea030e8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:18.533116 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-a351e00e-df98-4d58-b6e5-69314ea030e8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:18.543939 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-a351e00e-df98-4d58-b6e5-69314ea030e8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:18.543939 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-a351e00e-df98-4d58-b6e5-69314ea030e8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:18.543939 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a351e00e-df98-4d58-b6e5-69314ea030e8 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1674 microversion: 2.20 time: 0.156606 Dec 20 03:38:18.544451 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 580/1169] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:18 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:19.562745 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e3cf949e-f8c1-4ec5-8d7c-cee7ca85e5cc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:19.563393 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e3cf949e-f8c1-4ec5-8d7c-cee7ca85e5cc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:19.569600 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e3cf949e-f8c1-4ec5-8d7c-cee7ca85e5cc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:19.574130 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e3cf949e-f8c1-4ec5-8d7c-cee7ca85e5cc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:19.574948 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e3cf949e-f8c1-4ec5-8d7c-cee7ca85e5cc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:19.575392 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e3cf949e-f8c1-4ec5-8d7c-cee7ca85e5cc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:19.710214 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-e3cf949e-f8c1-4ec5-8d7c-cee7ca85e5cc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:19.719056 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-e3cf949e-f8c1-4ec5-8d7c-cee7ca85e5cc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:19.724887 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-e3cf949e-f8c1-4ec5-8d7c-cee7ca85e5cc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:19.724887 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e3cf949e-f8c1-4ec5-8d7c-cee7ca85e5cc tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1676 microversion: 2.20 time: 0.163449 Dec 20 03:38:19.724887 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 590/1170] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:19 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:20.741596 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f83f619e-849a-45bd-96b1-77c41aa1a5bf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:20.743256 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f83f619e-849a-45bd-96b1-77c41aa1a5bf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:20.749575 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f83f619e-849a-45bd-96b1-77c41aa1a5bf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:20.750283 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f83f619e-849a-45bd-96b1-77c41aa1a5bf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:20.751070 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f83f619e-849a-45bd-96b1-77c41aa1a5bf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:20.751514 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f83f619e-849a-45bd-96b1-77c41aa1a5bf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:20.887039 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-f83f619e-849a-45bd-96b1-77c41aa1a5bf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:20.894908 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-f83f619e-849a-45bd-96b1-77c41aa1a5bf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:20.896387 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-f83f619e-849a-45bd-96b1-77c41aa1a5bf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:20.897567 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f83f619e-849a-45bd-96b1-77c41aa1a5bf tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1732 microversion: 2.20 time: 0.159698 Dec 20 03:38:20.898347 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 581/1171] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:20 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:21.916889 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-ebfb13d7-af98-42ff-87bc-07444ca8792e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:21.917529 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-ebfb13d7-af98-42ff-87bc-07444ca8792e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:21.924179 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ebfb13d7-af98-42ff-87bc-07444ca8792e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:21.924913 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ebfb13d7-af98-42ff-87bc-07444ca8792e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:21.925943 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ebfb13d7-af98-42ff-87bc-07444ca8792e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:21.926577 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-ebfb13d7-af98-42ff-87bc-07444ca8792e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:22.075908 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ebfb13d7-af98-42ff-87bc-07444ca8792e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:22.084449 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ebfb13d7-af98-42ff-87bc-07444ca8792e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:22.086509 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-ebfb13d7-af98-42ff-87bc-07444ca8792e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:22.087612 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-ebfb13d7-af98-42ff-87bc-07444ca8792e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1732 microversion: 2.20 time: 0.175086 Dec 20 03:38:22.088402 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 591/1172] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:21 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:23.106519 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-c4c41e49-4326-411e-9b7d-622900236d5f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:23.107328 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-c4c41e49-4326-411e-9b7d-622900236d5f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:23.114583 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c4c41e49-4326-411e-9b7d-622900236d5f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:23.115143 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c4c41e49-4326-411e-9b7d-622900236d5f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:23.116485 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c4c41e49-4326-411e-9b7d-622900236d5f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:23.117012 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-c4c41e49-4326-411e-9b7d-622900236d5f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:23.265288 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c4c41e49-4326-411e-9b7d-622900236d5f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:23.279732 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c4c41e49-4326-411e-9b7d-622900236d5f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:23.281618 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-c4c41e49-4326-411e-9b7d-622900236d5f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:23.283039 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-c4c41e49-4326-411e-9b7d-622900236d5f tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1732 microversion: 2.20 time: 0.180983 Dec 20 03:38:23.283824 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 582/1173] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:23 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:24.306189 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-62f6ae25-a8c6-48fa-84e1-d8439cdc6855 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:24.306760 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-62f6ae25-a8c6-48fa-84e1-d8439cdc6855 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:24.313395 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-62f6ae25-a8c6-48fa-84e1-d8439cdc6855 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:24.313997 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-62f6ae25-a8c6-48fa-84e1-d8439cdc6855 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:24.314812 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-62f6ae25-a8c6-48fa-84e1-d8439cdc6855 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:24.315261 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-62f6ae25-a8c6-48fa-84e1-d8439cdc6855 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:24.470731 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-62f6ae25-a8c6-48fa-84e1-d8439cdc6855 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:24.479751 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-62f6ae25-a8c6-48fa-84e1-d8439cdc6855 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:24.481744 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-62f6ae25-a8c6-48fa-84e1-d8439cdc6855 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:24.483017 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-62f6ae25-a8c6-48fa-84e1-d8439cdc6855 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1732 microversion: 2.20 time: 0.183488 Dec 20 03:38:24.483664 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 592/1174] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:24 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:25.501470 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e4e58c06-00f4-4df2-b0a5-eb368efbd925 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:25.502278 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e4e58c06-00f4-4df2-b0a5-eb368efbd925 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:25.508377 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e4e58c06-00f4-4df2-b0a5-eb368efbd925 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:25.509603 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e4e58c06-00f4-4df2-b0a5-eb368efbd925 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:25.510663 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e4e58c06-00f4-4df2-b0a5-eb368efbd925 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:25.511166 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e4e58c06-00f4-4df2-b0a5-eb368efbd925 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:25.677106 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-e4e58c06-00f4-4df2-b0a5-eb368efbd925 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:25.686960 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-e4e58c06-00f4-4df2-b0a5-eb368efbd925 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:25.688605 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-e4e58c06-00f4-4df2-b0a5-eb368efbd925 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:25.689909 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e4e58c06-00f4-4df2-b0a5-eb368efbd925 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1732 microversion: 2.20 time: 0.192492 Dec 20 03:38:25.690494 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 583/1175] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:25 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1732 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:26.707822 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b992658f-cca7-4083-a708-40f212f4a1b2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:26.708526 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-b992658f-cca7-4083-a708-40f212f4a1b2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:26.715370 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b992658f-cca7-4083-a708-40f212f4a1b2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:26.715818 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b992658f-cca7-4083-a708-40f212f4a1b2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:26.716608 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b992658f-cca7-4083-a708-40f212f4a1b2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:26.717044 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b992658f-cca7-4083-a708-40f212f4a1b2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:26.860894 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b992658f-cca7-4083-a708-40f212f4a1b2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:26.870901 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b992658f-cca7-4083-a708-40f212f4a1b2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:26.872398 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-b992658f-cca7-4083-a708-40f212f4a1b2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:26.873582 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b992658f-cca7-4083-a708-40f212f4a1b2 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1732 microversion: 2.20 time: 0.169544 Dec 20 03:38:26.874142 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 593/1176] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:26 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:27.892370 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-71596fd4-ff8a-49a4-9286-9d298b9c9d09 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:27.892980 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-71596fd4-ff8a-49a4-9286-9d298b9c9d09 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:27.900398 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-71596fd4-ff8a-49a4-9286-9d298b9c9d09 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:27.900851 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-71596fd4-ff8a-49a4-9286-9d298b9c9d09 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:27.901876 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-71596fd4-ff8a-49a4-9286-9d298b9c9d09 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:27.902310 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-71596fd4-ff8a-49a4-9286-9d298b9c9d09 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:28.050297 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-71596fd4-ff8a-49a4-9286-9d298b9c9d09 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:28.062092 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-71596fd4-ff8a-49a4-9286-9d298b9c9d09 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:28.064247 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-71596fd4-ff8a-49a4-9286-9d298b9c9d09 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:28.065892 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-71596fd4-ff8a-49a4-9286-9d298b9c9d09 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1732 microversion: 2.20 time: 0.177246 Dec 20 03:38:28.066655 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 584/1177] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:27 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:29.084977 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-097f7b75-7fe3-42b5-a31a-0fd2fb54bf92 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:29.085641 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-097f7b75-7fe3-42b5-a31a-0fd2fb54bf92 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:29.092099 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-097f7b75-7fe3-42b5-a31a-0fd2fb54bf92 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:29.092562 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-097f7b75-7fe3-42b5-a31a-0fd2fb54bf92 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:29.093501 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-097f7b75-7fe3-42b5-a31a-0fd2fb54bf92 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:29.093962 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-097f7b75-7fe3-42b5-a31a-0fd2fb54bf92 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:29.230784 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-097f7b75-7fe3-42b5-a31a-0fd2fb54bf92 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:29.238516 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-097f7b75-7fe3-42b5-a31a-0fd2fb54bf92 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:29.240001 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-097f7b75-7fe3-42b5-a31a-0fd2fb54bf92 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:29.241163 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-097f7b75-7fe3-42b5-a31a-0fd2fb54bf92 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1732 microversion: 2.20 time: 0.159900 Dec 20 03:38:29.241721 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 594/1178] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:29 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:30.259588 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-4b953878-a68f-4673-91be-2f8daae33734 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:30.260313 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-4b953878-a68f-4673-91be-2f8daae33734 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:30.266506 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4b953878-a68f-4673-91be-2f8daae33734 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:30.266961 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4b953878-a68f-4673-91be-2f8daae33734 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:30.267746 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4b953878-a68f-4673-91be-2f8daae33734 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:30.268188 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-4b953878-a68f-4673-91be-2f8daae33734 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:30.425381 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-4b953878-a68f-4673-91be-2f8daae33734 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:30.434811 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-4b953878-a68f-4673-91be-2f8daae33734 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:30.436437 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-4b953878-a68f-4673-91be-2f8daae33734 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:30.437722 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-4b953878-a68f-4673-91be-2f8daae33734 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1732 microversion: 2.20 time: 0.181973 Dec 20 03:38:30.438467 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 585/1179] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:30 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:31.456064 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-91a64c29-8851-44e9-8996-fab2b86dc44e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:31.456795 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-91a64c29-8851-44e9-8996-fab2b86dc44e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:31.463748 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-91a64c29-8851-44e9-8996-fab2b86dc44e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:31.464204 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-91a64c29-8851-44e9-8996-fab2b86dc44e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:31.464989 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-91a64c29-8851-44e9-8996-fab2b86dc44e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:31.465457 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-91a64c29-8851-44e9-8996-fab2b86dc44e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:31.606526 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-91a64c29-8851-44e9-8996-fab2b86dc44e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:31.614520 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-91a64c29-8851-44e9-8996-fab2b86dc44e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:31.616005 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-91a64c29-8851-44e9-8996-fab2b86dc44e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:31.617228 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-91a64c29-8851-44e9-8996-fab2b86dc44e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1732 microversion: 2.20 time: 0.164776 Dec 20 03:38:31.617779 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 595/1180] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:31 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:32.635916 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-8b4f6a34-60f0-489c-ad86-9541061fc6f4 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:32.636545 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-8b4f6a34-60f0-489c-ad86-9541061fc6f4 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:32.642939 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8b4f6a34-60f0-489c-ad86-9541061fc6f4 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:32.643372 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8b4f6a34-60f0-489c-ad86-9541061fc6f4 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:32.644166 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8b4f6a34-60f0-489c-ad86-9541061fc6f4 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:32.644607 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8b4f6a34-60f0-489c-ad86-9541061fc6f4 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:32.785733 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-8b4f6a34-60f0-489c-ad86-9541061fc6f4 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:32.793846 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-8b4f6a34-60f0-489c-ad86-9541061fc6f4 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:32.795332 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-8b4f6a34-60f0-489c-ad86-9541061fc6f4 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:32.796488 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-8b4f6a34-60f0-489c-ad86-9541061fc6f4 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1732 microversion: 2.20 time: 0.165025 Dec 20 03:38:32.797412 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 586/1181] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:32 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:33.814792 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-59eee230-4713-4de9-914b-f23de626e9ff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:33.815496 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-59eee230-4713-4de9-914b-f23de626e9ff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:33.821561 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-59eee230-4713-4de9-914b-f23de626e9ff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:33.822014 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-59eee230-4713-4de9-914b-f23de626e9ff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:33.823157 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-59eee230-4713-4de9-914b-f23de626e9ff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:33.823590 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-59eee230-4713-4de9-914b-f23de626e9ff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:34.119932 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-59eee230-4713-4de9-914b-f23de626e9ff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:34.127916 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-59eee230-4713-4de9-914b-f23de626e9ff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:34.129428 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-59eee230-4713-4de9-914b-f23de626e9ff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:34.130566 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-59eee230-4713-4de9-914b-f23de626e9ff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1732 microversion: 2.20 time: 0.320001 Dec 20 03:38:34.131119 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 596/1182] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:33 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1732 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:35.149113 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-507bb8b3-a764-445d-a9b7-59784237c00b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:35.149727 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-507bb8b3-a764-445d-a9b7-59784237c00b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:35.156791 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-507bb8b3-a764-445d-a9b7-59784237c00b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:35.157281 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-507bb8b3-a764-445d-a9b7-59784237c00b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:35.158052 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-507bb8b3-a764-445d-a9b7-59784237c00b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:35.158484 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-507bb8b3-a764-445d-a9b7-59784237c00b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:35.360380 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-507bb8b3-a764-445d-a9b7-59784237c00b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:35.368563 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-507bb8b3-a764-445d-a9b7-59784237c00b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:35.370067 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-507bb8b3-a764-445d-a9b7-59784237c00b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:35.371205 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-507bb8b3-a764-445d-a9b7-59784237c00b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1732 microversion: 2.20 time: 0.225861 Dec 20 03:38:35.371765 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 587/1183] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:35 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1732 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 03:38:36.390494 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d129542c-b195-4e91-9d4c-bbb5d8bd3231 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:36.391100 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d129542c-b195-4e91-9d4c-bbb5d8bd3231 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:36.397890 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d129542c-b195-4e91-9d4c-bbb5d8bd3231 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:36.398566 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d129542c-b195-4e91-9d4c-bbb5d8bd3231 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:36.399157 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d129542c-b195-4e91-9d4c-bbb5d8bd3231 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:36.399593 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d129542c-b195-4e91-9d4c-bbb5d8bd3231 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:36.542827 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d129542c-b195-4e91-9d4c-bbb5d8bd3231 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:36.552042 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d129542c-b195-4e91-9d4c-bbb5d8bd3231 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:36.553609 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d129542c-b195-4e91-9d4c-bbb5d8bd3231 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:36.554804 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d129542c-b195-4e91-9d4c-bbb5d8bd3231 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1732 microversion: 2.20 time: 0.168190 Dec 20 03:38:36.555380 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 597/1184] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:36 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:37.573820 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-41b865b6-a703-4970-8f28-f352cf4bba59 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:37.574441 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-41b865b6-a703-4970-8f28-f352cf4bba59 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:37.581175 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-41b865b6-a703-4970-8f28-f352cf4bba59 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:37.581634 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-41b865b6-a703-4970-8f28-f352cf4bba59 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:37.582420 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-41b865b6-a703-4970-8f28-f352cf4bba59 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:37.582854 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-41b865b6-a703-4970-8f28-f352cf4bba59 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:37.713946 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-41b865b6-a703-4970-8f28-f352cf4bba59 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:37.722400 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-41b865b6-a703-4970-8f28-f352cf4bba59 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:37.723902 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-41b865b6-a703-4970-8f28-f352cf4bba59 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:37.725047 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-41b865b6-a703-4970-8f28-f352cf4bba59 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1732 microversion: 2.20 time: 0.155115 Dec 20 03:38:37.725625 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 588/1185] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:37 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:38.329214 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-cd2b2c98-d5ec-408c-909d-76cc6ea2194f req-6f7501ca-eba7-460d-a860-01fc8482085a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7866545-6bb6-419b-8357-857dc5ed59a3", "name": "network-vif-plugged", "status": "completed", "tag": "aa42babd-fe16-4436-b001-648058d3d1ee"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:38:38.330807 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:38:38.330807 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:38:38.338160 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-cd2b2c98-d5ec-408c-909d-76cc6ea2194f req-6f7501ca-eba7-460d-a860-01fc8482085a service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:38.341870 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-cd2b2c98-d5ec-408c-909d-76cc6ea2194f req-6f7501ca-eba7-460d-a860-01fc8482085a service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:38.349617 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-cd2b2c98-d5ec-408c-909d-76cc6ea2194f req-6f7501ca-eba7-460d-a860-01fc8482085a service nova] Creating event network-vif-plugged:aa42babd-fe16-4436-b001-648058d3d1ee for instance d7866545-6bb6-419b-8357-857dc5ed59a3 on hv-cinder-81803 Dec 20 03:38:38.354578 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-cd2b2c98-d5ec-408c-909d-76cc6ea2194f req-6f7501ca-eba7-460d-a860-01fc8482085a service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029763 Dec 20 03:38:38.355152 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 598/1186] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:38:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:38:38.743287 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-eb6a4458-0a92-4a64-91b4-804de62e6bc3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:38.743835 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-eb6a4458-0a92-4a64-91b4-804de62e6bc3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:38.751180 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-eb6a4458-0a92-4a64-91b4-804de62e6bc3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:38.751625 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-eb6a4458-0a92-4a64-91b4-804de62e6bc3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:38.752403 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-eb6a4458-0a92-4a64-91b4-804de62e6bc3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:38.752884 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-eb6a4458-0a92-4a64-91b4-804de62e6bc3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:39.151875 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-eb6a4458-0a92-4a64-91b4-804de62e6bc3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:39.160057 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-eb6a4458-0a92-4a64-91b4-804de62e6bc3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:39.161587 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-eb6a4458-0a92-4a64-91b4-804de62e6bc3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:39.162738 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-eb6a4458-0a92-4a64-91b4-804de62e6bc3 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1732 microversion: 2.20 time: 0.423289 Dec 20 03:38:39.163285 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 589/1187] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:38 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1732 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:40.182295 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-007b7cce-b7ca-4e2d-8ea6-3400e74a54df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:40.183469 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-007b7cce-b7ca-4e2d-8ea6-3400e74a54df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:40.190542 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-007b7cce-b7ca-4e2d-8ea6-3400e74a54df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:40.191013 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-007b7cce-b7ca-4e2d-8ea6-3400e74a54df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:40.191904 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-007b7cce-b7ca-4e2d-8ea6-3400e74a54df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:40.192421 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-007b7cce-b7ca-4e2d-8ea6-3400e74a54df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:40.341636 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-007b7cce-b7ca-4e2d-8ea6-3400e74a54df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:40.349385 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-007b7cce-b7ca-4e2d-8ea6-3400e74a54df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:40.350978 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-007b7cce-b7ca-4e2d-8ea6-3400e74a54df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:40.352136 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-007b7cce-b7ca-4e2d-8ea6-3400e74a54df tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1732 microversion: 2.20 time: 0.174791 Dec 20 03:38:40.352684 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 599/1188] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:40 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:41.370124 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-06672878-085a-4fbf-a8a0-24cad5a11eb9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:41.370664 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-06672878-085a-4fbf-a8a0-24cad5a11eb9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:41.377504 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-06672878-085a-4fbf-a8a0-24cad5a11eb9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:41.381023 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-06672878-085a-4fbf-a8a0-24cad5a11eb9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:41.381023 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-06672878-085a-4fbf-a8a0-24cad5a11eb9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:41.381023 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-06672878-085a-4fbf-a8a0-24cad5a11eb9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:41.512158 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-06672878-085a-4fbf-a8a0-24cad5a11eb9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:41.520260 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-06672878-085a-4fbf-a8a0-24cad5a11eb9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:41.521786 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-06672878-085a-4fbf-a8a0-24cad5a11eb9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:41.522929 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-06672878-085a-4fbf-a8a0-24cad5a11eb9 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1732 microversion: 2.20 time: 0.156681 Dec 20 03:38:41.523617 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 590/1189] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:41 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:38:42.541707 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-7a18fdfb-a381-4e0a-afc8-560c55657e18 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:38:42.542342 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-7a18fdfb-a381-4e0a-afc8-560c55657e18 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:38:42.549526 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7a18fdfb-a381-4e0a-afc8-560c55657e18 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:42.549977 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7a18fdfb-a381-4e0a-afc8-560c55657e18 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:42.550739 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7a18fdfb-a381-4e0a-afc8-560c55657e18 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:38:42.551172 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-7a18fdfb-a381-4e0a-afc8-560c55657e18 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:38:42.688190 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-7a18fdfb-a381-4e0a-afc8-560c55657e18 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:42.696101 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-7a18fdfb-a381-4e0a-afc8-560c55657e18 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:42.697658 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-7a18fdfb-a381-4e0a-afc8-560c55657e18 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:38:42.698794 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-7a18fdfb-a381-4e0a-afc8-560c55657e18 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1719 microversion: 2.20 time: 0.160859 Dec 20 03:38:42.699341 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 600/1190] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:38:42 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:39:15.509483 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-a14dc72f-6670-4f7b-a280-e32a9bb083bb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:15.510453 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-a14dc72f-6670-4f7b-a280-e32a9bb083bb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:15.519560 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a14dc72f-6670-4f7b-a280-e32a9bb083bb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:15.520027 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a14dc72f-6670-4f7b-a280-e32a9bb083bb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:15.520846 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a14dc72f-6670-4f7b-a280-e32a9bb083bb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:15.521310 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-a14dc72f-6670-4f7b-a280-e32a9bb083bb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:15.550214 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-a14dc72f-6670-4f7b-a280-e32a9bb083bb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044714 Dec 20 03:39:15.550792 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 591/1191] 10.222.0.53 () {60 vars in 1342 bytes} [Mon Dec 20 03:39:15 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:39:15.606658 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-20914fe8-5ca3-4307-ad5a-524b3b747d97 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:15.607232 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-20914fe8-5ca3-4307-ad5a-524b3b747d97 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:15.613291 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-20914fe8-5ca3-4307-ad5a-524b3b747d97 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:15.613841 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-20914fe8-5ca3-4307-ad5a-524b3b747d97 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:15.614612 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-20914fe8-5ca3-4307-ad5a-524b3b747d97 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:15.615046 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-20914fe8-5ca3-4307-ad5a-524b3b747d97 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:15.640892 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-20914fe8-5ca3-4307-ad5a-524b3b747d97 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Going to try to terminate instance {{(pid=117011) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:39:15.926137 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-20914fe8-5ca3-4307-ad5a-524b3b747d97 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "DELETE /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 204 len: 0 microversion: 2.20 time: 0.322125 Dec 20 03:39:15.926742 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 601/1192] 10.222.0.53 () {60 vars in 1279 bytes} [Mon Dec 20 03:39:15 2021] DELETE /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 20 03:39:15.934985 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-01035a29-6d1f-4899-a2e0-50d3aa98cdff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:15.935608 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-01035a29-6d1f-4899-a2e0-50d3aa98cdff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:15.942243 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-01035a29-6d1f-4899-a2e0-50d3aa98cdff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:15.942689 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-01035a29-6d1f-4899-a2e0-50d3aa98cdff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:15.943474 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-01035a29-6d1f-4899-a2e0-50d3aa98cdff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:15.943991 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-01035a29-6d1f-4899-a2e0-50d3aa98cdff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:16.077585 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-01035a29-6d1f-4899-a2e0-50d3aa98cdff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:16.086068 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-01035a29-6d1f-4899-a2e0-50d3aa98cdff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:16.087600 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-01035a29-6d1f-4899-a2e0-50d3aa98cdff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:16.088752 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-01035a29-6d1f-4899-a2e0-50d3aa98cdff tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1725 microversion: 2.20 time: 0.157611 Dec 20 03:39:16.089403 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 592/1193] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:39:15 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:39:17.109001 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d4f80a5f-9c55-41e6-9133-fb35bcfab52b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:17.109716 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d4f80a5f-9c55-41e6-9133-fb35bcfab52b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:17.116677 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d4f80a5f-9c55-41e6-9133-fb35bcfab52b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:17.117127 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d4f80a5f-9c55-41e6-9133-fb35bcfab52b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:17.117930 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d4f80a5f-9c55-41e6-9133-fb35bcfab52b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:17.118388 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d4f80a5f-9c55-41e6-9133-fb35bcfab52b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:17.247086 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d4f80a5f-9c55-41e6-9133-fb35bcfab52b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:17.255600 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d4f80a5f-9c55-41e6-9133-fb35bcfab52b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:17.257091 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-d4f80a5f-9c55-41e6-9133-fb35bcfab52b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:17.258257 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d4f80a5f-9c55-41e6-9133-fb35bcfab52b tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1725 microversion: 2.20 time: 0.153426 Dec 20 03:39:17.258809 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 602/1194] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:39:17 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:39:18.278236 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-7f0f589e-a4fb-4c2d-aeab-888dfce4d29e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:18.279110 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-7f0f589e-a4fb-4c2d-aeab-888dfce4d29e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:18.289037 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7f0f589e-a4fb-4c2d-aeab-888dfce4d29e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:18.289625 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7f0f589e-a4fb-4c2d-aeab-888dfce4d29e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:18.290426 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7f0f589e-a4fb-4c2d-aeab-888dfce4d29e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:18.290934 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-7f0f589e-a4fb-4c2d-aeab-888dfce4d29e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:18.382897 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7f0f589e-a4fb-4c2d-aeab-888dfce4d29e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:18.390724 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7f0f589e-a4fb-4c2d-aeab-888dfce4d29e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:18.392202 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-7f0f589e-a4fb-4c2d-aeab-888dfce4d29e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:18.393372 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-7f0f589e-a4fb-4c2d-aeab-888dfce4d29e tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1657 microversion: 2.20 time: 0.120712 Dec 20 03:39:18.393917 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 593/1195] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:39:18 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1657 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:39:18.570772 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-c281196c-bef6-4c75-bd8a-278462426fdf req-b407e81f-e21d-46ed-a7eb-e05d61ee8665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7866545-6bb6-419b-8357-857dc5ed59a3", "name": "network-vif-deleted", "tag": "aa42babd-fe16-4436-b001-648058d3d1ee"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:39:18.573075 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:39:18.573075 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:39:18.580960 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-c281196c-bef6-4c75-bd8a-278462426fdf req-b407e81f-e21d-46ed-a7eb-e05d61ee8665 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:18.583020 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-c281196c-bef6-4c75-bd8a-278462426fdf req-b407e81f-e21d-46ed-a7eb-e05d61ee8665 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:18.595347 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-c281196c-bef6-4c75-bd8a-278462426fdf req-b407e81f-e21d-46ed-a7eb-e05d61ee8665 service nova] Creating event network-vif-deleted:aa42babd-fe16-4436-b001-648058d3d1ee for instance d7866545-6bb6-419b-8357-857dc5ed59a3 on hv-cinder-81803 Dec 20 03:39:18.601409 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-c281196c-bef6-4c75-bd8a-278462426fdf req-b407e81f-e21d-46ed-a7eb-e05d61ee8665 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034048 Dec 20 03:39:18.602180 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 603/1196] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:39:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:39:19.410675 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-444222ee-bea6-4f21-9238-4eecf56b6eab tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:19.412031 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-444222ee-bea6-4f21-9238-4eecf56b6eab tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:19.419039 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-444222ee-bea6-4f21-9238-4eecf56b6eab tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:19.421733 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-444222ee-bea6-4f21-9238-4eecf56b6eab tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:19.421733 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-444222ee-bea6-4f21-9238-4eecf56b6eab tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:19.421733 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-444222ee-bea6-4f21-9238-4eecf56b6eab tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:19.452601 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-444222ee-bea6-4f21-9238-4eecf56b6eab tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:19.453083 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-444222ee-bea6-4f21-9238-4eecf56b6eab tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:19.453567 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.objects.instance [None req-444222ee-bea6-4f21-9238-4eecf56b6eab tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lazy-loading 'fault' on Instance uuid d7866545-6bb6-419b-8357-857dc5ed59a3 {{(pid=117012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:39:19.496203 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-444222ee-bea6-4f21-9238-4eecf56b6eab tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:19.502026 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-444222ee-bea6-4f21-9238-4eecf56b6eab tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:19.503474 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-444222ee-bea6-4f21-9238-4eecf56b6eab tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cedc29bf2c8490db1977aa5613380d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a8965a4b4645829a64cb1f5aec4f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:19.504626 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-444222ee-bea6-4f21-9238-4eecf56b6eab tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 200 len: 1372 microversion: 2.20 time: 0.097824 Dec 20 03:39:19.506892 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 594/1197] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:39:19 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 03:39:20.524627 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b2f6587b-df09-47ec-a04e-26857a7dd9cb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:20.525375 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-b2f6587b-df09-47ec-a04e-26857a7dd9cb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:20.531852 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b2f6587b-df09-47ec-a04e-26857a7dd9cb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:20.532296 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b2f6587b-df09-47ec-a04e-26857a7dd9cb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:20.533057 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b2f6587b-df09-47ec-a04e-26857a7dd9cb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:20.533518 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-b2f6587b-df09-47ec-a04e-26857a7dd9cb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:20.546852 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-b2f6587b-df09-47ec-a04e-26857a7dd9cb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] HTTP exception thrown: Instance d7866545-6bb6-419b-8357-857dc5ed59a3 could not be found. Dec 20 03:39:20.547435 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-b2f6587b-df09-47ec-a04e-26857a7dd9cb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Returning 404 to user: Instance d7866545-6bb6-419b-8357-857dc5ed59a3 could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:39:20.548228 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-b2f6587b-df09-47ec-a04e-26857a7dd9cb tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 404 len: 111 microversion: 2.20 time: 0.028166 Dec 20 03:39:20.548746 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 604/1198] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:39:20 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 20 03:39:20.557292 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-796dfe56-1e0c-41f0-94bd-69d33f271a09 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '.version_select at 0x7f4904543ee0>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:20.666170 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-796dfe56-1e0c-41f0-94bd-69d33f271a09 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1108431963" status: 204 len: 0 microversion: 2.20 time: 0.112543 Dec 20 03:39:20.666908 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 595/1199] 10.222.0.53 () {60 vars in 1261 bytes} [Mon Dec 20 03:39:20 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1108431963 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 20 03:39:22.747680 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f5efe062-25ed-4987-b884-c955597a9e38 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:22.748236 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-f5efe062-25ed-4987-b884-c955597a9e38 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:22.754865 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f5efe062-25ed-4987-b884-c955597a9e38 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:22.755338 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f5efe062-25ed-4987-b884-c955597a9e38 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:22.756105 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f5efe062-25ed-4987-b884-c955597a9e38 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:22.756533 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f5efe062-25ed-4987-b884-c955597a9e38 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:22.769304 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-f5efe062-25ed-4987-b884-c955597a9e38 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] HTTP exception thrown: Instance d7866545-6bb6-419b-8357-857dc5ed59a3 could not be found. Dec 20 03:39:22.769888 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f5efe062-25ed-4987-b884-c955597a9e38 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Returning 404 to user: Instance d7866545-6bb6-419b-8357-857dc5ed59a3 could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:39:22.771248 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f5efe062-25ed-4987-b884-c955597a9e38 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "DELETE /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 404 len: 111 microversion: 2.20 time: 0.026722 Dec 20 03:39:22.771922 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 605/1200] 10.222.0.53 () {60 vars in 1279 bytes} [Mon Dec 20 03:39:22 2021] DELETE /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 20 03:39:22.779740 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-800c88c4-5f14-4a15-8363-8e33f6513992 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:22.780351 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-800c88c4-5f14-4a15-8363-8e33f6513992 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: d7866545-6bb6-419b-8357-857dc5ed59a3] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:22.788195 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-800c88c4-5f14-4a15-8363-8e33f6513992 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:22.788648 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-800c88c4-5f14-4a15-8363-8e33f6513992 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:22.789462 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-800c88c4-5f14-4a15-8363-8e33f6513992 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:22.789904 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-800c88c4-5f14-4a15-8363-8e33f6513992 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:22.803492 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-800c88c4-5f14-4a15-8363-8e33f6513992 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] HTTP exception thrown: Instance d7866545-6bb6-419b-8357-857dc5ed59a3 could not be found. Dec 20 03:39:22.804088 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-800c88c4-5f14-4a15-8363-8e33f6513992 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Returning 404 to user: Instance d7866545-6bb6-419b-8357-857dc5ed59a3 could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:39:22.804916 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-800c88c4-5f14-4a15-8363-8e33f6513992 tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3" status: 404 len: 111 microversion: 2.20 time: 0.028988 Dec 20 03:39:22.805502 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 596/1201] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:39:22 2021] GET /compute/v2.1/servers/d7866545-6bb6-419b-8357-857dc5ed59a3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 20 03:39:24.068364 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1d00c7c0-5d69-4c96-8327-4026976be3fd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:24.068875 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1d00c7c0-5d69-4c96-8327-4026976be3fd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:24.075105 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1d00c7c0-5d69-4c96-8327-4026976be3fd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:24.075547 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1d00c7c0-5d69-4c96-8327-4026976be3fd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:24.076326 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1d00c7c0-5d69-4c96-8327-4026976be3fd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:24.076756 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1d00c7c0-5d69-4c96-8327-4026976be3fd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:24.090881 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-1d00c7c0-5d69-4c96-8327-4026976be3fd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] HTTP exception thrown: Instance 4a1645c1-a90b-406b-ba58-0620598ecf89 could not be found. Dec 20 03:39:24.091469 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1d00c7c0-5d69-4c96-8327-4026976be3fd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Returning 404 to user: Instance 4a1645c1-a90b-406b-ba58-0620598ecf89 could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:39:24.092272 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1d00c7c0-5d69-4c96-8327-4026976be3fd tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "DELETE /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 404 len: 111 microversion: 2.20 time: 0.027876 Dec 20 03:39:24.092805 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 606/1202] 10.222.0.53 () {60 vars in 1279 bytes} [Mon Dec 20 03:39:24 2021] DELETE /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 20 03:39:24.101548 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-82a94d0c-8487-4de2-ac54-1db62bc01d4a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:24.102276 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-82a94d0c-8487-4de2-ac54-1db62bc01d4a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] [instance: 4a1645c1-a90b-406b-ba58-0620598ecf89] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:24.108699 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-82a94d0c-8487-4de2-ac54-1db62bc01d4a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:24.109168 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-82a94d0c-8487-4de2-ac54-1db62bc01d4a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:24.109979 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-82a94d0c-8487-4de2-ac54-1db62bc01d4a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:24.110422 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-82a94d0c-8487-4de2-ac54-1db62bc01d4a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:24.125359 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-82a94d0c-8487-4de2-ac54-1db62bc01d4a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] HTTP exception thrown: Instance 4a1645c1-a90b-406b-ba58-0620598ecf89 could not be found. Dec 20 03:39:24.125986 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-82a94d0c-8487-4de2-ac54-1db62bc01d4a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] Returning 404 to user: Instance 4a1645c1-a90b-406b-ba58-0620598ecf89 could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:39:24.126817 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-82a94d0c-8487-4de2-ac54-1db62bc01d4a tempest-AttachVolumeShelveTestJSON-1954963734 tempest-AttachVolumeShelveTestJSON-1954963734-project] 10.222.0.53 "GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89" status: 404 len: 111 microversion: 2.20 time: 0.029982 Dec 20 03:39:24.127363 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 597/1203] 10.222.0.53 () {60 vars in 1276 bytes} [Mon Dec 20 03:39:24 2021] GET /compute/v2.1/servers/4a1645c1-a90b-406b-ba58-0620598ecf89 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 20 03:39:37.920928 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-5519d055-9cd2-427c-88ee-c5703d152fef tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1140214631", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-832830598", "security_groups": [{"name": "tempest-secgroup-smoke-1005542187"}], "block_device_mapping_v2": [{"uuid": "becd6788-b203-49fd-a74e-defb1d536219", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "247f1037-2c21-483f-b1d2-d9c7b96998be"}]}} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:39:38.037407 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.network.neutron [None req-5519d055-9cd2-427c-88ee-c5703d152fef tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] validate_networks() for [('247f1037-2c21-483f-b1d2-d9c7b96998be', None, None, None, None, None)] {{(pid=117011) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 03:39:38.514909 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-5519d055-9cd2-427c-88ee-c5703d152fef tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Flavor limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 03:39:38.515336 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-5519d055-9cd2-427c-88ee-c5703d152fef tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Image limits 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 03:39:38.515829 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-5519d055-9cd2-427c-88ee-c5703d152fef tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Flavor pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 03:39:38.516223 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-5519d055-9cd2-427c-88ee-c5703d152fef tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Image pref 0:0:0 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 03:39:38.516734 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.virt.hardware [None req-5519d055-9cd2-427c-88ee-c5703d152fef tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 03:39:38.526023 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5519d055-9cd2-427c-88ee-c5703d152fef tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:38.526612 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5519d055-9cd2-427c-88ee-c5703d152fef tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:38.527429 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5519d055-9cd2-427c-88ee-c5703d152fef tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:38.527866 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-5519d055-9cd2-427c-88ee-c5703d152fef tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:38.545206 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-5519d055-9cd2-427c-88ee-c5703d152fef tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Getting quotas for project d4fa0cffd767432cae1c69fa4e26e6c5. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 03:39:38.549174 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.quota [None req-5519d055-9cd2-427c-88ee-c5703d152fef tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Getting quotas for user 0a13354364b2443cb3ba387ec4893d67 and project d4fa0cffd767432cae1c69fa4e26e6c5. Resources: {'instances', 'ram', 'cores'} {{(pid=117011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 03:39:38.620242 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-5519d055-9cd2-427c-88ee-c5703d152fef tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Going to run 1 instances... {{(pid=117011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 03:39:38.622504 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-5519d055-9cd2-427c-88ee-c5703d152fef tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='becd6788-b203-49fd-a74e-defb1d536219',volume_size=None,volume_type=None)] {{(pid=117011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 03:39:39.118256 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-5519d055-9cd2-427c-88ee-c5703d152fef tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.201189 Dec 20 03:39:39.119201 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 607/1204] 10.222.0.53 () {60 vars in 1146 bytes} [Mon Dec 20 03:39:37 2021] POST /compute/v2.1/servers => generated 406 bytes in 1203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 03:39:39.129063 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-5b32eee6-55f5-4481-bc05-50ee56894996 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:39.129685 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-5b32eee6-55f5-4481-bc05-50ee56894996 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:39.188342 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-5b32eee6-55f5-4481-bc05-50ee56894996 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:39.194918 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-5b32eee6-55f5-4481-bc05-50ee56894996 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1094 microversion: 2.1 time: 0.069764 Dec 20 03:39:39.195480 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 598/1205] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:39:39 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:39:40.212056 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-03697a92-1482-4fa7-b6c7-171704964eb1 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:40.212753 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-03697a92-1482-4fa7-b6c7-171704964eb1 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:40.219871 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-03697a92-1482-4fa7-b6c7-171704964eb1 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:40.220407 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-03697a92-1482-4fa7-b6c7-171704964eb1 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:40.221296 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-03697a92-1482-4fa7-b6c7-171704964eb1 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:40.223428 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-03697a92-1482-4fa7-b6c7-171704964eb1 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:40.294979 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-03697a92-1482-4fa7-b6c7-171704964eb1 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:40.302283 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-03697a92-1482-4fa7-b6c7-171704964eb1 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1144 microversion: 2.1 time: 0.094377 Dec 20 03:39:40.302842 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 608/1206] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:39:40 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1144 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:39:41.319652 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-f359c912-1bd7-4577-bf75-f90208faadb2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:41.320276 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-f359c912-1bd7-4577-bf75-f90208faadb2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:41.328601 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f359c912-1bd7-4577-bf75-f90208faadb2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:41.329065 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f359c912-1bd7-4577-bf75-f90208faadb2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:41.330079 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f359c912-1bd7-4577-bf75-f90208faadb2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:41.330530 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-f359c912-1bd7-4577-bf75-f90208faadb2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:41.425913 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-f359c912-1bd7-4577-bf75-f90208faadb2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:41.435827 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-f359c912-1bd7-4577-bf75-f90208faadb2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1200 microversion: 2.1 time: 0.120075 Dec 20 03:39:41.436892 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 599/1207] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:39:41 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1200 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:39:42.452752 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-1f3c1a93-6ca3-45d5-b599-b4da32faa71e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:42.454029 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-1f3c1a93-6ca3-45d5-b599-b4da32faa71e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:42.461008 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1f3c1a93-6ca3-45d5-b599-b4da32faa71e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:42.461522 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1f3c1a93-6ca3-45d5-b599-b4da32faa71e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:42.462422 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1f3c1a93-6ca3-45d5-b599-b4da32faa71e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:42.463050 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-1f3c1a93-6ca3-45d5-b599-b4da32faa71e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:42.610447 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-1f3c1a93-6ca3-45d5-b599-b4da32faa71e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:42.618911 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-1f3c1a93-6ca3-45d5-b599-b4da32faa71e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1278 microversion: 2.1 time: 0.169688 Dec 20 03:39:42.619493 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 609/1208] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:39:42 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:39:43.642866 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ea179737-a72f-4395-b3c8-0403806a8a09 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:43.642866 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ea179737-a72f-4395-b3c8-0403806a8a09 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:43.649760 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ea179737-a72f-4395-b3c8-0403806a8a09 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:43.650787 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ea179737-a72f-4395-b3c8-0403806a8a09 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:43.651895 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ea179737-a72f-4395-b3c8-0403806a8a09 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:43.652586 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ea179737-a72f-4395-b3c8-0403806a8a09 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:43.653863 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-a1daaa62-07cb-4186-9893-6a1f5387247a req-5389689d-dc84-43bc-aff4-a87ab014314a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a25de0f8-ea6d-45e9-ac80-ba8e9e518103", "tag": "91c8ad15-12c7-4a71-a36b-721ab7bb7bcc"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:39:43.655516 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:39:43.655516 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:39:43.667211 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-a1daaa62-07cb-4186-9893-6a1f5387247a req-5389689d-dc84-43bc-aff4-a87ab014314a service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:43.671437 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-a1daaa62-07cb-4186-9893-6a1f5387247a req-5389689d-dc84-43bc-aff4-a87ab014314a service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:43.681221 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-a1daaa62-07cb-4186-9893-6a1f5387247a req-5389689d-dc84-43bc-aff4-a87ab014314a service nova] Creating event network-changed:91c8ad15-12c7-4a71-a36b-721ab7bb7bcc for instance a25de0f8-ea6d-45e9-ac80-ba8e9e518103 on hv-cinder-81803 Dec 20 03:39:43.688578 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-a1daaa62-07cb-4186-9893-6a1f5387247a req-5389689d-dc84-43bc-aff4-a87ab014314a service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038325 Dec 20 03:39:43.689492 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 610/1209] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:39:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:39:44.071554 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-ea179737-a72f-4395-b3c8-0403806a8a09 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:44.079864 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ea179737-a72f-4395-b3c8-0403806a8a09 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1266 microversion: 2.1 time: 0.445629 Dec 20 03:39:44.080434 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 600/1210] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:39:43 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1266 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:39:45.096632 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-87da289d-3ece-4f52-bd5a-6dd1ea075e57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:45.097352 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-87da289d-3ece-4f52-bd5a-6dd1ea075e57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:45.103886 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-87da289d-3ece-4f52-bd5a-6dd1ea075e57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:45.104337 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-87da289d-3ece-4f52-bd5a-6dd1ea075e57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:45.105119 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-87da289d-3ece-4f52-bd5a-6dd1ea075e57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:45.105575 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-87da289d-3ece-4f52-bd5a-6dd1ea075e57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:45.259593 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-87da289d-3ece-4f52-bd5a-6dd1ea075e57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:45.268275 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-87da289d-3ece-4f52-bd5a-6dd1ea075e57 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1266 microversion: 2.1 time: 0.175970 Dec 20 03:39:45.268887 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 611/1211] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:39:45 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:39:46.284373 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-10ef3e56-24ae-46c0-9e06-6203214fa54c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:46.284972 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-10ef3e56-24ae-46c0-9e06-6203214fa54c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:46.291412 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-10ef3e56-24ae-46c0-9e06-6203214fa54c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:46.291861 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-10ef3e56-24ae-46c0-9e06-6203214fa54c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:46.292675 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-10ef3e56-24ae-46c0-9e06-6203214fa54c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:46.293104 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-10ef3e56-24ae-46c0-9e06-6203214fa54c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:46.431432 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-10ef3e56-24ae-46c0-9e06-6203214fa54c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:46.438903 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-10ef3e56-24ae-46c0-9e06-6203214fa54c tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1266 microversion: 2.1 time: 0.158677 Dec 20 03:39:46.439469 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 601/1212] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:39:46 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:39:47.455566 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-37d7ce39-afd8-49ff-94d4-e5d4f64e822e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:47.456183 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-37d7ce39-afd8-49ff-94d4-e5d4f64e822e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:47.463609 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-37d7ce39-afd8-49ff-94d4-e5d4f64e822e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:47.464235 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-37d7ce39-afd8-49ff-94d4-e5d4f64e822e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:47.465303 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-37d7ce39-afd8-49ff-94d4-e5d4f64e822e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:47.465843 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-37d7ce39-afd8-49ff-94d4-e5d4f64e822e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:47.610023 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-37d7ce39-afd8-49ff-94d4-e5d4f64e822e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:47.617261 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-37d7ce39-afd8-49ff-94d4-e5d4f64e822e tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1266 microversion: 2.1 time: 0.165264 Dec 20 03:39:47.627060 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 612/1213] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:39:47 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:39:48.634334 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-99469aa6-d33e-419f-a248-a04373bf6573 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:48.634931 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-99469aa6-d33e-419f-a248-a04373bf6573 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:48.641271 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-99469aa6-d33e-419f-a248-a04373bf6573 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:48.641723 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-99469aa6-d33e-419f-a248-a04373bf6573 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:48.642503 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-99469aa6-d33e-419f-a248-a04373bf6573 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:48.642950 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-99469aa6-d33e-419f-a248-a04373bf6573 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:48.787359 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-99469aa6-d33e-419f-a248-a04373bf6573 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:48.796273 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-99469aa6-d33e-419f-a248-a04373bf6573 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1266 microversion: 2.1 time: 0.165699 Dec 20 03:39:48.796828 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 602/1214] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:39:48 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:39:49.812780 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-e420e151-7fef-4c5c-812b-b58c1b6cc768 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:49.813468 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-e420e151-7fef-4c5c-812b-b58c1b6cc768 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:49.819776 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e420e151-7fef-4c5c-812b-b58c1b6cc768 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:49.820790 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e420e151-7fef-4c5c-812b-b58c1b6cc768 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:49.821612 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e420e151-7fef-4c5c-812b-b58c1b6cc768 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:49.822048 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-e420e151-7fef-4c5c-812b-b58c1b6cc768 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:49.955043 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-e420e151-7fef-4c5c-812b-b58c1b6cc768 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:49.963639 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-e420e151-7fef-4c5c-812b-b58c1b6cc768 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1266 microversion: 2.1 time: 0.154404 Dec 20 03:39:49.964452 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 613/1215] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:39:49 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:39:50.985790 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-e2cc9c5b-a484-4702-91a1-e30e2ab6dd44 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:50.986680 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-e2cc9c5b-a484-4702-91a1-e30e2ab6dd44 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:50.996728 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e2cc9c5b-a484-4702-91a1-e30e2ab6dd44 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:50.997473 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e2cc9c5b-a484-4702-91a1-e30e2ab6dd44 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:50.998764 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e2cc9c5b-a484-4702-91a1-e30e2ab6dd44 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:50.999482 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-e2cc9c5b-a484-4702-91a1-e30e2ab6dd44 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:51.139556 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-e2cc9c5b-a484-4702-91a1-e30e2ab6dd44 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:51.146807 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-e2cc9c5b-a484-4702-91a1-e30e2ab6dd44 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1266 microversion: 2.1 time: 0.166492 Dec 20 03:39:51.147370 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 603/1216] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:39:50 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:39:52.164442 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-9519cde0-7ad0-41ca-b08e-6f13a0bc66ca tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:52.164978 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-9519cde0-7ad0-41ca-b08e-6f13a0bc66ca tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:52.171443 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9519cde0-7ad0-41ca-b08e-6f13a0bc66ca tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:52.171893 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9519cde0-7ad0-41ca-b08e-6f13a0bc66ca tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:52.172683 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9519cde0-7ad0-41ca-b08e-6f13a0bc66ca tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:52.173122 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9519cde0-7ad0-41ca-b08e-6f13a0bc66ca tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:52.307656 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9519cde0-7ad0-41ca-b08e-6f13a0bc66ca tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:52.315113 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-9519cde0-7ad0-41ca-b08e-6f13a0bc66ca tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1266 microversion: 2.1 time: 0.154949 Dec 20 03:39:52.315683 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 614/1217] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:39:52 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:39:53.331556 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-bc6cc006-2625-4286-ae81-b191f4d68803 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:53.332169 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-bc6cc006-2625-4286-ae81-b191f4d68803 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:53.339094 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bc6cc006-2625-4286-ae81-b191f4d68803 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:53.339541 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bc6cc006-2625-4286-ae81-b191f4d68803 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:53.340347 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bc6cc006-2625-4286-ae81-b191f4d68803 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:53.340784 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-bc6cc006-2625-4286-ae81-b191f4d68803 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:53.478906 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-bc6cc006-2625-4286-ae81-b191f4d68803 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:53.486741 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-bc6cc006-2625-4286-ae81-b191f4d68803 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1266 microversion: 2.1 time: 0.158665 Dec 20 03:39:53.487326 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 604/1218] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:39:53 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:39:54.504016 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-9bbfa58f-ea0d-4112-b0e5-0df989ab8a2f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:54.504720 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-9bbfa58f-ea0d-4112-b0e5-0df989ab8a2f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:54.511239 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9bbfa58f-ea0d-4112-b0e5-0df989ab8a2f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:54.511689 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9bbfa58f-ea0d-4112-b0e5-0df989ab8a2f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:54.512466 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9bbfa58f-ea0d-4112-b0e5-0df989ab8a2f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:54.512944 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-9bbfa58f-ea0d-4112-b0e5-0df989ab8a2f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:54.657940 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-9bbfa58f-ea0d-4112-b0e5-0df989ab8a2f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:54.667161 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-9bbfa58f-ea0d-4112-b0e5-0df989ab8a2f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1266 microversion: 2.1 time: 0.166905 Dec 20 03:39:54.667775 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 615/1219] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:39:54 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:39:54.895792 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-8a5f08c9-4839-49dc-833b-b162332c2e6f req-db3177e2-6f6d-40d9-bfb6-e7c6234c0259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25de0f8-ea6d-45e9-ac80-ba8e9e518103", "name": "network-vif-plugged", "status": "completed", "tag": "91c8ad15-12c7-4a71-a36b-721ab7bb7bcc"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:39:54.897419 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:39:54.897419 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:39:54.906808 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-8a5f08c9-4839-49dc-833b-b162332c2e6f req-db3177e2-6f6d-40d9-bfb6-e7c6234c0259 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:54.906808 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-8a5f08c9-4839-49dc-833b-b162332c2e6f req-db3177e2-6f6d-40d9-bfb6-e7c6234c0259 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:54.918086 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-8a5f08c9-4839-49dc-833b-b162332c2e6f req-db3177e2-6f6d-40d9-bfb6-e7c6234c0259 service nova] Creating event network-vif-plugged:91c8ad15-12c7-4a71-a36b-721ab7bb7bcc for instance a25de0f8-ea6d-45e9-ac80-ba8e9e518103 on hv-cinder-81803 Dec 20 03:39:54.923235 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-8a5f08c9-4839-49dc-833b-b162332c2e6f req-db3177e2-6f6d-40d9-bfb6-e7c6234c0259 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031194 Dec 20 03:39:54.923845 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 605/1220] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:39:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:39:55.683655 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-2b909c2d-d302-41e4-a188-3bd49a7978f8 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:55.684295 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-2b909c2d-d302-41e4-a188-3bd49a7978f8 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:55.690915 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2b909c2d-d302-41e4-a188-3bd49a7978f8 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:55.691368 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2b909c2d-d302-41e4-a188-3bd49a7978f8 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:55.692152 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2b909c2d-d302-41e4-a188-3bd49a7978f8 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:55.692591 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2b909c2d-d302-41e4-a188-3bd49a7978f8 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:55.827831 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-2b909c2d-d302-41e4-a188-3bd49a7978f8 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:55.835375 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-2b909c2d-d302-41e4-a188-3bd49a7978f8 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1266 microversion: 2.1 time: 0.155470 Dec 20 03:39:55.835944 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 616/1221] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:39:55 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:39:56.853561 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-d8c660af-a886-4819-97fb-14929c908a8f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:56.854301 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-d8c660af-a886-4819-97fb-14929c908a8f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:56.860370 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d8c660af-a886-4819-97fb-14929c908a8f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:56.860831 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d8c660af-a886-4819-97fb-14929c908a8f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:56.861651 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d8c660af-a886-4819-97fb-14929c908a8f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:56.862096 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-d8c660af-a886-4819-97fb-14929c908a8f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:56.994197 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-d8c660af-a886-4819-97fb-14929c908a8f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:57.001942 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-d8c660af-a886-4819-97fb-14929c908a8f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1453 microversion: 2.1 time: 0.152977 Dec 20 03:39:57.002510 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 606/1222] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:39:56 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:39:57.019023 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-4c4a0910-f598-4c42-9f2a-814cd79b098d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:39:57.019626 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-4c4a0910-f598-4c42-9f2a-814cd79b098d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:39:57.026679 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4c4a0910-f598-4c42-9f2a-814cd79b098d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:57.027223 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4c4a0910-f598-4c42-9f2a-814cd79b098d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:57.028077 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4c4a0910-f598-4c42-9f2a-814cd79b098d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:57.028583 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-4c4a0910-f598-4c42-9f2a-814cd79b098d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:57.167035 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-4c4a0910-f598-4c42-9f2a-814cd79b098d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:39:57.174622 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-4c4a0910-f598-4c42-9f2a-814cd79b098d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1453 microversion: 2.1 time: 0.159154 Dec 20 03:39:57.175192 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 617/1223] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:39:57 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:39:59.397130 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-2d726b3a-fa66-4401-a415-d990f55b279a req-109a22cb-ae46-4ea1-a91b-c74fc6478e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a25de0f8-ea6d-45e9-ac80-ba8e9e518103", "tag": "91c8ad15-12c7-4a71-a36b-721ab7bb7bcc"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:39:59.398697 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:39:59.398697 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:39:59.407191 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-2d726b3a-fa66-4401-a415-d990f55b279a req-109a22cb-ae46-4ea1-a91b-c74fc6478e09 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:39:59.407510 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-2d726b3a-fa66-4401-a415-d990f55b279a req-109a22cb-ae46-4ea1-a91b-c74fc6478e09 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:39:59.420720 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-2d726b3a-fa66-4401-a415-d990f55b279a req-109a22cb-ae46-4ea1-a91b-c74fc6478e09 service nova] Creating event network-changed:91c8ad15-12c7-4a71-a36b-721ab7bb7bcc for instance a25de0f8-ea6d-45e9-ac80-ba8e9e518103 on hv-cinder-81803 Dec 20 03:39:59.425736 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-2d726b3a-fa66-4401-a415-d990f55b279a req-109a22cb-ae46-4ea1-a91b-c74fc6478e09 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032125 Dec 20 03:39:59.426660 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 607/1224] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:39:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:41:53.584636 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee08b250-98ee-4199-8310-92b385db9a57] AMQP server on 10.222.0.53:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 20 03:41:53.587677 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: ERROR oslo.messaging._drivers.impl_rabbit [-] [77e40903-b90d-4a3a-ab72-acc67336db50] AMQP server on 10.222.0.53:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 20 03:41:53.591297 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-669e7222-5449-40ea-b03b-62cd4055fc79 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:41:53.591791 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-669e7222-5449-40ea-b03b-62cd4055fc79 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:41:53.598215 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-669e7222-5449-40ea-b03b-62cd4055fc79 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:41:53.598684 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-669e7222-5449-40ea-b03b-62cd4055fc79 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:41:53.599502 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-669e7222-5449-40ea-b03b-62cd4055fc79 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:41:53.599920 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-669e7222-5449-40ea-b03b-62cd4055fc79 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:41:53.626896 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-669e7222-5449-40ea-b03b-62cd4055fc79 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Going to try to terminate instance {{(pid=117011) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:41:53.729636 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-f07b9691-0542-4488-ac00-88bb04deaed2 req-995ebc4e-9048-41f9-a772-1f2fcda6ff04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a25de0f8-ea6d-45e9-ac80-ba8e9e518103", "tag": "91c8ad15-12c7-4a71-a36b-721ab7bb7bcc"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:41:53.731104 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:41:53.731104 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:41:53.739487 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-f07b9691-0542-4488-ac00-88bb04deaed2 req-995ebc4e-9048-41f9-a772-1f2fcda6ff04 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:41:53.739931 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-f07b9691-0542-4488-ac00-88bb04deaed2 req-995ebc4e-9048-41f9-a772-1f2fcda6ff04 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:41:53.752061 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-f07b9691-0542-4488-ac00-88bb04deaed2 req-995ebc4e-9048-41f9-a772-1f2fcda6ff04 service nova] Creating event network-changed:91c8ad15-12c7-4a71-a36b-721ab7bb7bcc for instance a25de0f8-ea6d-45e9-ac80-ba8e9e518103 on hv-cinder-81803 Dec 20 03:41:53.757306 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-f07b9691-0542-4488-ac00-88bb04deaed2 req-995ebc4e-9048-41f9-a772-1f2fcda6ff04 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175827 Dec 20 03:41:53.758194 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 608/1225] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:41:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:41:53.847053 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-669e7222-5449-40ea-b03b-62cd4055fc79 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "DELETE /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 204 len: 0 microversion: 2.1 time: 0.267480 Dec 20 03:41:53.850820 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 618/1226] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:41:53 2021] DELETE /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:41:53.857411 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-1440154b-2c6b-4cb3-849f-9cff9367c77a tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:41:53.858134 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-1440154b-2c6b-4cb3-849f-9cff9367c77a tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:41:53.871389 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1440154b-2c6b-4cb3-849f-9cff9367c77a tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:41:53.871864 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1440154b-2c6b-4cb3-849f-9cff9367c77a tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:41:53.872679 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1440154b-2c6b-4cb3-849f-9cff9367c77a tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:41:53.873370 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-1440154b-2c6b-4cb3-849f-9cff9367c77a tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:41:54.115915 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-1440154b-2c6b-4cb3-849f-9cff9367c77a tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:41:54.123371 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-1440154b-2c6b-4cb3-849f-9cff9367c77a tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1578 microversion: 2.1 time: 0.271053 Dec 20 03:41:54.123975 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 609/1227] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:41:53 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1578 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:41:55.142077 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-f3757942-1c60-428e-9133-48f0a4e34043 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:41:55.142845 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-f3757942-1c60-428e-9133-48f0a4e34043 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:41:55.160307 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f3757942-1c60-428e-9133-48f0a4e34043 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:41:55.160750 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f3757942-1c60-428e-9133-48f0a4e34043 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:41:55.161557 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f3757942-1c60-428e-9133-48f0a4e34043 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:41:55.161987 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-f3757942-1c60-428e-9133-48f0a4e34043 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:41:55.177496 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO oslo.messaging._drivers.impl_rabbit [-] [77e40903-b90d-4a3a-ab72-acc67336db50] Reconnected to AMQP server on 10.222.0.53:5672 via [amqp] client with port 43870. Dec 20 03:41:55.302217 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-f3757942-1c60-428e-9133-48f0a4e34043 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:41:55.309620 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-f3757942-1c60-428e-9133-48f0a4e34043 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1459 microversion: 2.1 time: 0.172097 Dec 20 03:41:55.314353 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 619/1228] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:41:55 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1459 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:41:56.328189 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-478de242-824c-455f-a582-0ee92567d203 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:41:56.328741 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-478de242-824c-455f-a582-0ee92567d203 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:41:56.346061 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-478de242-824c-455f-a582-0ee92567d203 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:41:56.346793 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-478de242-824c-455f-a582-0ee92567d203 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:41:56.348049 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-478de242-824c-455f-a582-0ee92567d203 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:41:56.348773 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-478de242-824c-455f-a582-0ee92567d203 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:41:56.355595 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee08b250-98ee-4199-8310-92b385db9a57] Reconnected to AMQP server on 10.222.0.53:5672 via [amqp] client with port 43874. Dec 20 03:41:56.484799 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-478de242-824c-455f-a582-0ee92567d203 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:41:56.492209 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-478de242-824c-455f-a582-0ee92567d203 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1459 microversion: 2.1 time: 0.167753 Dec 20 03:41:56.492767 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 610/1229] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:41:56 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1459 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:41:57.509428 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-30f82771-6fab-4147-88c7-035f2da19e31 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:41:57.512515 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-30f82771-6fab-4147-88c7-035f2da19e31 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:41:57.516620 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-30f82771-6fab-4147-88c7-035f2da19e31 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:41:57.517070 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-30f82771-6fab-4147-88c7-035f2da19e31 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:41:57.517887 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-30f82771-6fab-4147-88c7-035f2da19e31 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:41:57.518393 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-30f82771-6fab-4147-88c7-035f2da19e31 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:41:57.653054 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-30f82771-6fab-4147-88c7-035f2da19e31 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:41:57.661661 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-30f82771-6fab-4147-88c7-035f2da19e31 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1459 microversion: 2.1 time: 0.156021 Dec 20 03:41:57.662216 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 620/1230] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:41:57 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1459 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:41:58.678290 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-8705810c-0b32-4407-8838-bdd9b2fb38cc tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:41:58.678891 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-8705810c-0b32-4407-8838-bdd9b2fb38cc tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:41:58.685202 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8705810c-0b32-4407-8838-bdd9b2fb38cc tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:41:58.685655 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8705810c-0b32-4407-8838-bdd9b2fb38cc tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:41:58.686431 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8705810c-0b32-4407-8838-bdd9b2fb38cc tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:41:58.687433 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-8705810c-0b32-4407-8838-bdd9b2fb38cc tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:41:58.819582 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-8705810c-0b32-4407-8838-bdd9b2fb38cc tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:41:58.827039 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-8705810c-0b32-4407-8838-bdd9b2fb38cc tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1459 microversion: 2.1 time: 0.152370 Dec 20 03:41:58.828376 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 611/1231] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:41:58 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1459 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:41:59.382866 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-c0131234-6de0-4a8d-9104-b959e1fa7287 req-dd303d77-da5c-44e4-8d9e-de07cba1a428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25de0f8-ea6d-45e9-ac80-ba8e9e518103", "name": "network-vif-unplugged", "status": "completed", "tag": "91c8ad15-12c7-4a71-a36b-721ab7bb7bcc"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:41:59.384344 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:41:59.384344 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:41:59.391067 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-c0131234-6de0-4a8d-9104-b959e1fa7287 req-dd303d77-da5c-44e4-8d9e-de07cba1a428 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:41:59.391503 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-c0131234-6de0-4a8d-9104-b959e1fa7287 req-dd303d77-da5c-44e4-8d9e-de07cba1a428 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:41:59.403916 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-c0131234-6de0-4a8d-9104-b959e1fa7287 req-dd303d77-da5c-44e4-8d9e-de07cba1a428 service nova] Creating event network-vif-unplugged:91c8ad15-12c7-4a71-a36b-721ab7bb7bcc for instance a25de0f8-ea6d-45e9-ac80-ba8e9e518103 on hv-cinder-81803 Dec 20 03:41:59.409634 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-c0131234-6de0-4a8d-9104-b959e1fa7287 req-dd303d77-da5c-44e4-8d9e-de07cba1a428 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090168 Dec 20 03:41:59.420560 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 621/1232] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:41:59 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:41:59.845440 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-cbf1b41f-2f13-4e0a-870f-aa3ffbb35c88 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:41:59.846075 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-cbf1b41f-2f13-4e0a-870f-aa3ffbb35c88 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:41:59.852251 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cbf1b41f-2f13-4e0a-870f-aa3ffbb35c88 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:41:59.852697 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cbf1b41f-2f13-4e0a-870f-aa3ffbb35c88 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:41:59.853496 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cbf1b41f-2f13-4e0a-870f-aa3ffbb35c88 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:41:59.853933 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-cbf1b41f-2f13-4e0a-870f-aa3ffbb35c88 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:41:59.990133 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-cbf1b41f-2f13-4e0a-870f-aa3ffbb35c88 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:41:59.997752 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-cbf1b41f-2f13-4e0a-870f-aa3ffbb35c88 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1459 microversion: 2.1 time: 0.157023 Dec 20 03:41:59.998320 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 612/1233] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:41:59 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1459 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:42:01.016875 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0f5be9fc-8555-4cc9-8a99-ede9a8bce1f4 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:42:01.017537 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-0f5be9fc-8555-4cc9-8a99-ede9a8bce1f4 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:42:01.023691 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0f5be9fc-8555-4cc9-8a99-ede9a8bce1f4 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:01.024138 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0f5be9fc-8555-4cc9-8a99-ede9a8bce1f4 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:01.024923 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0f5be9fc-8555-4cc9-8a99-ede9a8bce1f4 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:01.025396 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0f5be9fc-8555-4cc9-8a99-ede9a8bce1f4 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:01.167609 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-0f5be9fc-8555-4cc9-8a99-ede9a8bce1f4 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:42:01.175995 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-0f5be9fc-8555-4cc9-8a99-ede9a8bce1f4 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1459 microversion: 2.1 time: 0.164294 Dec 20 03:42:01.176567 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 622/1234] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:42:01 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1459 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:42:01.563391 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-eefb6e3e-28db-4274-8eee-3bf567dc0bad req-0e0fa6f4-4286-4b40-989a-5d7b124b7f5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25de0f8-ea6d-45e9-ac80-ba8e9e518103", "name": "network-vif-deleted", "tag": "91c8ad15-12c7-4a71-a36b-721ab7bb7bcc"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:42:01.564952 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:42:01.564952 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:42:01.572260 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-eefb6e3e-28db-4274-8eee-3bf567dc0bad req-0e0fa6f4-4286-4b40-989a-5d7b124b7f5b service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:01.572745 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-eefb6e3e-28db-4274-8eee-3bf567dc0bad req-0e0fa6f4-4286-4b40-989a-5d7b124b7f5b service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:01.584815 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-eefb6e3e-28db-4274-8eee-3bf567dc0bad req-0e0fa6f4-4286-4b40-989a-5d7b124b7f5b service nova] Creating event network-vif-deleted:91c8ad15-12c7-4a71-a36b-721ab7bb7bcc for instance a25de0f8-ea6d-45e9-ac80-ba8e9e518103 on hv-cinder-81803 Dec 20 03:42:01.590039 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-eefb6e3e-28db-4274-8eee-3bf567dc0bad req-0e0fa6f4-4286-4b40-989a-5d7b124b7f5b service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087429 Dec 20 03:42:01.590669 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 613/1235] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:42:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:42:02.193988 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-43980d8c-e1da-4c4b-b90e-fcf61959e474 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:42:02.195107 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-43980d8c-e1da-4c4b-b90e-fcf61959e474 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:42:02.204369 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-43980d8c-e1da-4c4b-b90e-fcf61959e474 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:02.204824 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-43980d8c-e1da-4c4b-b90e-fcf61959e474 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:02.205658 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-43980d8c-e1da-4c4b-b90e-fcf61959e474 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:02.206096 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-43980d8c-e1da-4c4b-b90e-fcf61959e474 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:02.240836 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-43980d8c-e1da-4c4b-b90e-fcf61959e474 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:02.241406 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-43980d8c-e1da-4c4b-b90e-fcf61959e474 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:02.242057 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.objects.instance [None req-43980d8c-e1da-4c4b-b90e-fcf61959e474 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lazy-loading 'fault' on Instance uuid a25de0f8-ea6d-45e9-ac80-ba8e9e518103 {{(pid=117011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:42:02.289127 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-43980d8c-e1da-4c4b-b90e-fcf61959e474 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:42:02.297690 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-43980d8c-e1da-4c4b-b90e-fcf61959e474 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 200 len: 1230 microversion: 2.1 time: 0.108001 Dec 20 03:42:02.298337 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 623/1236] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:42:02 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 03:42:03.315766 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-392b1d34-0ca2-4cdb-b80b-c99a383ee4ae tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:42:03.316459 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-392b1d34-0ca2-4cdb-b80b-c99a383ee4ae tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: a25de0f8-ea6d-45e9-ac80-ba8e9e518103] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:42:03.322975 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-392b1d34-0ca2-4cdb-b80b-c99a383ee4ae tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:03.323433 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-392b1d34-0ca2-4cdb-b80b-c99a383ee4ae tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:03.324211 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-392b1d34-0ca2-4cdb-b80b-c99a383ee4ae tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:03.324647 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-392b1d34-0ca2-4cdb-b80b-c99a383ee4ae tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:03.337568 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-392b1d34-0ca2-4cdb-b80b-c99a383ee4ae tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] HTTP exception thrown: Instance a25de0f8-ea6d-45e9-ac80-ba8e9e518103 could not be found. Dec 20 03:42:03.338159 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-392b1d34-0ca2-4cdb-b80b-c99a383ee4ae tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Returning 404 to user: Instance a25de0f8-ea6d-45e9-ac80-ba8e9e518103 could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:42:03.338976 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-392b1d34-0ca2-4cdb-b80b-c99a383ee4ae tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103" status: 404 len: 111 microversion: 2.1 time: 0.027956 Dec 20 03:42:03.339506 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 614/1237] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:42:03 2021] GET /compute/v2.1/servers/a25de0f8-ea6d-45e9-ac80-ba8e9e518103 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:42:06.710011 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [req-9b158f22-fc5d-4da8-b4b5-aa957c017582 req-b5c00ded-37d3-497b-852e-a9662b8d2c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f14bb563-0377-452e-bd8a-a367eaffe2de", "tag": "c3bb1e5e-eba4-4be2-ae44-80c4d75e395c"}]} {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:42:06.712545 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-d75a6286-43c7-4a2b-99c2-40a919a0c968 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:42:06.713042 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d75a6286-43c7-4a2b-99c2-40a919a0c968 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:42:06.717397 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:42:06.717397 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: warnings.warn(msg) Dec 20 03:42:06.720486 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d75a6286-43c7-4a2b-99c2-40a919a0c968 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:06.720952 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d75a6286-43c7-4a2b-99c2-40a919a0c968 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:06.721772 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d75a6286-43c7-4a2b-99c2-40a919a0c968 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:06.722395 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-d75a6286-43c7-4a2b-99c2-40a919a0c968 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:06.725596 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-9b158f22-fc5d-4da8-b4b5-aa957c017582 req-b5c00ded-37d3-497b-852e-a9662b8d2c7b service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:06.726297 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [req-9b158f22-fc5d-4da8-b4b5-aa957c017582 req-b5c00ded-37d3-497b-852e-a9662b8d2c7b service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:06.740279 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.compute.server_external_events [req-9b158f22-fc5d-4da8-b4b5-aa957c017582 req-b5c00ded-37d3-497b-852e-a9662b8d2c7b service nova] Creating event network-changed:c3bb1e5e-eba4-4be2-ae44-80c4d75e395c for instance f14bb563-0377-452e-bd8a-a367eaffe2de on hv-cinder-81803 Dec 20 03:42:06.745481 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [req-9b158f22-fc5d-4da8-b4b5-aa957c017582 req-b5c00ded-37d3-497b-852e-a9662b8d2c7b service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038998 Dec 20 03:42:06.746462 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 615/1238] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:42:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 03:42:06.750709 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-d75a6286-43c7-4a2b-99c2-40a919a0c968 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Going to try to terminate instance {{(pid=117011) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 03:42:07.121062 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-d75a6286-43c7-4a2b-99c2-40a919a0c968 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "DELETE /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 204 len: 0 microversion: 2.1 time: 0.417690 Dec 20 03:42:07.122017 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 624/1239] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:42:06 2021] DELETE /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 03:42:07.131734 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-ec22c3a8-0582-4d03-a7fe-3986cd0001af tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:42:07.132436 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-ec22c3a8-0582-4d03-a7fe-3986cd0001af tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:42:07.139455 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ec22c3a8-0582-4d03-a7fe-3986cd0001af tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:07.140287 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ec22c3a8-0582-4d03-a7fe-3986cd0001af tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:07.141114 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ec22c3a8-0582-4d03-a7fe-3986cd0001af tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:07.142288 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-ec22c3a8-0582-4d03-a7fe-3986cd0001af tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:07.421230 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-ec22c3a8-0582-4d03-a7fe-3986cd0001af tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:42:07.431917 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-ec22c3a8-0582-4d03-a7fe-3986cd0001af tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1577 microversion: 2.1 time: 0.304098 Dec 20 03:42:07.433300 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 616/1240] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:42:07 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1577 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:42:08.452492 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-2e8b952d-8587-42ab-bf17-044347fa00fe tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:42:08.458245 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-2e8b952d-8587-42ab-bf17-044347fa00fe tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:42:08.460156 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2e8b952d-8587-42ab-bf17-044347fa00fe tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:08.460607 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2e8b952d-8587-42ab-bf17-044347fa00fe tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:08.461446 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2e8b952d-8587-42ab-bf17-044347fa00fe tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:08.461880 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-2e8b952d-8587-42ab-bf17-044347fa00fe tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:08.602301 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-2e8b952d-8587-42ab-bf17-044347fa00fe tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:42:08.609832 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-2e8b952d-8587-42ab-bf17-044347fa00fe tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1459 microversion: 2.1 time: 0.161352 Dec 20 03:42:08.611100 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 625/1241] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:42:08 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1459 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:42:09.631314 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-dda90785-6bae-4149-b21f-abfb768138e2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:42:09.632115 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-dda90785-6bae-4149-b21f-abfb768138e2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:42:09.639747 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dda90785-6bae-4149-b21f-abfb768138e2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:09.642315 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dda90785-6bae-4149-b21f-abfb768138e2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:09.643148 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dda90785-6bae-4149-b21f-abfb768138e2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:09.643793 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-dda90785-6bae-4149-b21f-abfb768138e2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:09.675525 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [req-7ad60b20-14af-463b-95d2-75bf4e8eac61 req-669307e9-780e-42d7-a5e3-4471f49366e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f14bb563-0377-452e-bd8a-a367eaffe2de", "name": "network-vif-deleted", "tag": "c3bb1e5e-eba4-4be2-ae44-80c4d75e395c"}]} {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 03:42:09.677946 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 03:42:09.677946 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: warnings.warn(msg) Dec 20 03:42:09.685545 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-7ad60b20-14af-463b-95d2-75bf4e8eac61 req-669307e9-780e-42d7-a5e3-4471f49366e9 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:09.689041 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [req-7ad60b20-14af-463b-95d2-75bf4e8eac61 req-669307e9-780e-42d7-a5e3-4471f49366e9 service nova] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:09.697641 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.compute.server_external_events [req-7ad60b20-14af-463b-95d2-75bf4e8eac61 req-669307e9-780e-42d7-a5e3-4471f49366e9 service nova] Creating event network-vif-deleted:c3bb1e5e-eba4-4be2-ae44-80c4d75e395c for instance f14bb563-0377-452e-bd8a-a367eaffe2de on hv-cinder-81803 Dec 20 03:42:09.702469 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [req-7ad60b20-14af-463b-95d2-75bf4e8eac61 req-669307e9-780e-42d7-a5e3-4471f49366e9 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031652 Dec 20 03:42:09.703065 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 626/1242] 10.222.0.53 () {64 vars in 1317 bytes} [Mon Dec 20 03:42:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 03:42:09.718097 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.policy [None req-dda90785-6bae-4149-b21f-abfb768138e2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117012) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:42:09.721309 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-dda90785-6bae-4149-b21f-abfb768138e2 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1391 microversion: 2.1 time: 0.094140 Dec 20 03:42:09.721879 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 617/1243] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:42:09 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1391 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:42:10.739046 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-0bc2e020-b744-4da3-9a63-eb568adef579 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:42:10.739739 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-0bc2e020-b744-4da3-9a63-eb568adef579 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:42:10.745748 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0bc2e020-b744-4da3-9a63-eb568adef579 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:10.746198 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0bc2e020-b744-4da3-9a63-eb568adef579 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:10.746973 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0bc2e020-b744-4da3-9a63-eb568adef579 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:10.747413 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0bc2e020-b744-4da3-9a63-eb568adef579 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:10.782832 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0bc2e020-b744-4da3-9a63-eb568adef579 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:10.783278 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-0bc2e020-b744-4da3-9a63-eb568adef579 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:10.783716 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.objects.instance [None req-0bc2e020-b744-4da3-9a63-eb568adef579 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lazy-loading 'fault' on Instance uuid f14bb563-0377-452e-bd8a-a367eaffe2de {{(pid=117011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 03:42:10.823436 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.policy [None req-0bc2e020-b744-4da3-9a63-eb568adef579 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a13354364b2443cb3ba387ec4893d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa0cffd767432cae1c69fa4e26e6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117011) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 03:42:10.831658 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-0bc2e020-b744-4da3-9a63-eb568adef579 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 200 len: 1230 microversion: 2.1 time: 0.097132 Dec 20 03:42:10.832226 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 627/1244] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:42:10 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 03:42:11.847579 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-befb0301-fbe8-4270-8c2d-2c3eb5a82f6d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:42:11.848185 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-befb0301-fbe8-4270-8c2d-2c3eb5a82f6d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: f14bb563-0377-452e-bd8a-a367eaffe2de] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:42:11.854440 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-befb0301-fbe8-4270-8c2d-2c3eb5a82f6d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:11.854886 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-befb0301-fbe8-4270-8c2d-2c3eb5a82f6d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:11.855665 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-befb0301-fbe8-4270-8c2d-2c3eb5a82f6d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:11.856103 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-befb0301-fbe8-4270-8c2d-2c3eb5a82f6d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:11.869406 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-befb0301-fbe8-4270-8c2d-2c3eb5a82f6d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] HTTP exception thrown: Instance f14bb563-0377-452e-bd8a-a367eaffe2de could not be found. Dec 20 03:42:11.870027 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-befb0301-fbe8-4270-8c2d-2c3eb5a82f6d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Returning 404 to user: Instance f14bb563-0377-452e-bd8a-a367eaffe2de could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:42:11.870835 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-befb0301-fbe8-4270-8c2d-2c3eb5a82f6d tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de" status: 404 len: 111 microversion: 2.1 time: 0.027006 Dec 20 03:42:11.871356 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 618/1245] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:42:11 2021] GET /compute/v2.1/servers/f14bb563-0377-452e-bd8a-a367eaffe2de => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:42:12.656348 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-3018fae4-35b0-4f75-904d-1e609945360b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:42:12.656872 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.compute.api [None req-3018fae4-35b0-4f75-904d-1e609945360b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117011) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:42:12.664199 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3018fae4-35b0-4f75-904d-1e609945360b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:12.664658 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3018fae4-35b0-4f75-904d-1e609945360b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:12.665489 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3018fae4-35b0-4f75-904d-1e609945360b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:12.665933 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG oslo_concurrency.lockutils [None req-3018fae4-35b0-4f75-904d-1e609945360b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:12.679366 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.wsgi [None req-3018fae4-35b0-4f75-904d-1e609945360b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] HTTP exception thrown: Instance b572f265-bb17-4489-a53a-432eb4815ac6 could not be found. Dec 20 03:42:12.679966 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-3018fae4-35b0-4f75-904d-1e609945360b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Returning 404 to user: Instance b572f265-bb17-4489-a53a-432eb4815ac6 could not be found. {{(pid=117011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:42:12.680790 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-3018fae4-35b0-4f75-904d-1e609945360b tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "DELETE /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 404 len: 111 microversion: 2.1 time: 0.028310 Dec 20 03:42:12.681359 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 628/1246] 10.222.0.53 () {58 vars in 1238 bytes} [Mon Dec 20 03:42:12 2021] DELETE /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:42:12.689813 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-3728f2bb-8509-4c44-a611-998cc3dfaa4f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '>' {{(pid=117012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:42:12.690424 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.compute.api [None req-3728f2bb-8509-4c44-a611-998cc3dfaa4f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] [instance: b572f265-bb17-4489-a53a-432eb4815ac6] Fetching instance by UUID {{(pid=117012) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 03:42:12.696352 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3728f2bb-8509-4c44-a611-998cc3dfaa4f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:12.696825 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3728f2bb-8509-4c44-a611-998cc3dfaa4f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:12.697651 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3728f2bb-8509-4c44-a611-998cc3dfaa4f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 03:42:12.698086 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG oslo_concurrency.lockutils [None req-3728f2bb-8509-4c44-a611-998cc3dfaa4f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Lock "aee21a6b-374f-4375-aa47-f4018ba93cc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 03:42:12.711936 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.wsgi [None req-3728f2bb-8509-4c44-a611-998cc3dfaa4f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] HTTP exception thrown: Instance b572f265-bb17-4489-a53a-432eb4815ac6 could not be found. Dec 20 03:42:12.712518 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: DEBUG nova.api.openstack.wsgi [None req-3728f2bb-8509-4c44-a611-998cc3dfaa4f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Returning 404 to user: Instance b572f265-bb17-4489-a53a-432eb4815ac6 could not be found. {{(pid=117012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 03:42:12.713349 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: INFO nova.api.openstack.requestlog [None req-3728f2bb-8509-4c44-a611-998cc3dfaa4f tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6" status: 404 len: 111 microversion: 2.1 time: 0.027658 Dec 20 03:42:12.713876 dv-cinder-818037-11-iscsi devstack@n-api.service[117012]: [pid: 117012|app: 0|req: 619/1247] 10.222.0.53 () {58 vars in 1235 bytes} [Mon Dec 20 03:42:12 2021] GET /compute/v2.1/servers/b572f265-bb17-4489-a53a-432eb4815ac6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 03:42:14.199926 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: DEBUG nova.api.openstack.wsgi [None req-5af27cab-9b32-4bc5-98c0-7be454510171 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] Calling method '.version_select at 0x7f48fff9f790>' {{(pid=117011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 03:42:14.287508 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: INFO nova.api.openstack.requestlog [None req-5af27cab-9b32-4bc5-98c0-7be454510171 tempest-TestVolumeBootPattern-363963046 tempest-TestVolumeBootPattern-363963046-project] 10.222.0.53 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-832830598" status: 202 len: 0 microversion: 2.1 time: 0.091151 Dec 20 03:42:14.288086 dv-cinder-818037-11-iscsi devstack@n-api.service[117011]: [pid: 117011|app: 0|req: 629/1248] 10.222.0.53 () {58 vars in 1259 bytes} [Mon Dec 20 03:42:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-832830598 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)